00000001:02000400:0.0F:1788837438.854273:0:3303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_hostid 00000001:02000400:0.0:1788837463.617370:0:3525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788837465.615139:0:3586:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 495 MB/s 00000001:01000000:3.0F:1788837465.867676:0:3586:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 412 MB/s 00000001:01000000:2.0:1788837466.117909:0:3586:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3743 MB/s 00000020:02000000:0.0:1788837467.002836:0:3617:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_112_g92cfe64 00000400:02000000:0.0:1788837468.281439:0:3632:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.103@tcp [8/256/0/180] 00008000:02000000:1.0F:1788837472.420060:0:3782:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788837536.402717:0:5751:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788837550.640848:0:6501:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788837550.640857:0:6501:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788837550.640858:0:6501:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788837550.640971:0:6501:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000087ce0877 00000080:02000400:2.0:1788837550.640982:0:6501:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788837550.649712:0:6501:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788837550.649729:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788837550.649765:0:6501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000091c8eef) 00000020:00000080:2.0:1788837550.654188:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788837550.718600:0:6501:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788837550.718671:0:6501:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1788837550.753090:0:6501:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788837550.753298:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788837550.753306:0:6501:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788837550.753322:0:6501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926aeeaa9 00000020:01000004:3.0:1788837550.753328:0:6501:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788837550.753333:0:6501:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788837550.753337:0:6501:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000087ce0877 from MGS 00000020:01000004:3.0:1788837550.753341:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788837550.753360:0:6501:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000003b9b202d) 00000020:00000080:3.0:1788837550.753372:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788837550.753473:0:6501:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000087ce0877 from MGS, refs=2 00080000:01000000:3.0:1788837550.753478:0:6501:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788837550.753483:0:6501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926aeeab7 00000100:00100000:3.0:1788837550.753568:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788837550.753764:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788837550.753771:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788837550.762079:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788837550.762095:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788837550.762801:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788837550.763064:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788837550.763069:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788837550.764192:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788837550.764199:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788837550.765198:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788837550.765208:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788837550.765845:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837550.765849:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837550.765850:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837550.766320:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837550.766323:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837550.766325:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837550.767022:0:6501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788837550.771318:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788837551.015861:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4003 MB/s 00000001:01000000:2.0:1788837551.265916:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3175 MB/s 00000001:01000000:2.0:1788837551.517470:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 434 MB/s 00000001:01000000:3.0:1788837551.768237:0:6501:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 613 MB/s 00080000:10000000:3.0:1788837551.780696:0:6501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1788837551.801128:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788837551.805288:0:6501:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788837551.808567:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788837551.808627:0:6501:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788837551.808684:0:6501:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788837551.809159:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788837551.809186:0:6501:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788837551.809604:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837551.810994:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788837551.811004:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788837551.815435:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788837551.815448:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788837551.816217:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788837551.816225:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788837551.818117:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788837551.818145:0:6501:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.103@tcp' 00000020:01000004:2.0:1788837551.818147:0:6501:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788837551.818199:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.103@tcp (typ=mgc) 00000020:00000080:2.0:1788837551.818212:0:6501:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.103@tcp (000000007a257a93) 00000020:00000080:2.0:1788837551.818228:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788837551.818311:0:6501:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005456cb6d@MGC192.168.201.103@tcp: add connection 192.168.201.103@tcp at head 00010000:00010000:2.0:1788837551.818473:0:6501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.103@tcp-0 is initialized 00000040:01000000:2.0:1788837551.818478:0:6501:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788837551.821510:0:6521:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788837551.821566:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.103@tcp (uuid b603ecff-2147-4e64-a76e-e3f6861ab0fb) 00000020:00000080:0.0:1788837551.821593:0:6501:0:(genops.c:1385:class_connect()) connect: client b603ecff-2147-4e64-a76e-e3f6861ab0fb, cookie 0x57f6d4e926aeeac5 00000100:00080000:0.0:1788837551.821606:0:6501:0:(import.c:510:import_select_connection()) MGC192.168.201.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788837551.821612:0:6501:0:(import.c:624:import_select_connection()) MGC192.168.201.103@tcp: import 000000005456cb6d using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788837551.821670:0:6501:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c1d9dc07 x1875732036845696/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837551.821804:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3647:1875732036845696:0@lo:250: 00000100:00080000:1.0:1788837551.823126:0:6520:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1788837551.823467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788837551.823544:0:6501:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b603ecff-2147-4e64-a76e-e3f6861ab0fb->MGS 00000020:01000004:0.0:1788837551.823576:0:6501:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788837551.823584:0:6501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788837551.823611:0:6501:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000916149c3) 00000020:00000080:0.0:1788837551.823629:0:6501:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788837551.824875:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036845696 00000100:00100000:2.0:1788837551.824887:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036845696 00000100:00100000:2.0:1788837551.824927:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837551.824933:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0467c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1875732036845696:12345-0@lo:250: 00010000:00080000:2.0:1788837551.824958:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b603ecff-2147-4e64-a76e-e3f6861ab0fb@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:2.0:1788837551.824994:0:6516:0:(genops.c:1385:class_connect()) connect: client b603ecff-2147-4e64-a76e-e3f6861ab0fb, cookie 0x57f6d4e926aeead3 00000100:00080000:2.0:1788837551.825145:0:6516:0:(import.c:65:import_set_state_nolock()) 000000008f3c7ca6 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837551.825244:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0467c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+5:3647:x1875732036845696:12345-0@lo:250: Request processed in 311us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837551.825252:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837551.825806:0:3647:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788837551.825816:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.103@tcp: connect to target with instance 0 00000100:00080000:0.0:1788837551.825830:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788837551.825834:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788837551.825837:0:3647:0:(import.c:65:import_set_state_nolock()) 000000005456cb6d MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788837551.825840:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788837551.825848:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788837551.825853:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3647:1875732036845696:0@lo:250: 00000100:00100000:0.0:1788837551.852475:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837551.852770:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788837551.853115:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788837551.854355:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788837551.854366:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788837551.854760:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788837551.854767:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788837551.855580:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837551.855998:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788837551.856004:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788837551.856612:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788837551.856619:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788837551.892403:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837551.892573:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788837551.892577:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788837551.895020:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788837551.895035:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788837551.895948:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837551.896253:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788837551.896260:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788837551.897060:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788837551.897067:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788837551.897675:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837551.898069:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788837551.898074:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788837551.898573:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788837551.898579:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788837551.902450:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837551.902677:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788837551.902682:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788837551.903554:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788837551.903563:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788837551.929326:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837551.929577:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788837551.929583:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788837551.932753:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788837551.932769:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788837551.934000:0:6501:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788837551.934011:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788837551.935915:0:6501:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788837551.935953:0:6501:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788837551.935959:0:6501:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788837551.936063:0:6501:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788837551.936093:0:6501:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.103@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788837551.936098:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788837551.936099:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837551.936100:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837551.936101:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837551.936102:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837551.936107:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837551.936108:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837551.936109:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837551.936111:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788837551.936112:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788837551.936113:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837551.936114:0:6501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788837551.936116:0:6501:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788837551.936118:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788837551.936119:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837551.936120:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837551.936121:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837551.936122:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837551.936123:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837551.936124:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837551.936124:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837551.936125:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788837551.936126:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788837551.936127:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837551.936128:0:6501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788837551.936327:0:6501:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788837551.936345:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036845824:0@lo:253: 00000100:00100000:0.0:1788837551.936416:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837551.936516:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 000000003655c555 going to sleep for 11 seconds 00000100:00100000:1.0:1788837551.936574:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036845824 00000100:00100000:1.0:1788837551.936582:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036845824 00000100:00100000:1.0:1788837551.936690:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837551.936698:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a70a0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+5:6501:x1875732036845824:12345-0@lo:253: 20000000:01000000:1.0:1788837551.936751:0:6519:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788837551.936754:0:6519:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788837551.937248:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788837551.937304:0:6519:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788837551.937596:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837551.938938:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788837551.939206:0:6519:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788837551.939211:0:6519:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788837551.939216:0:6519:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788837551.939219:0:6519:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788837551.939235:0:6519:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788837551.939383:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788837551.939585:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788837551.939598:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788837551.939615:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788837551.939631:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788837551.939646:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788837551.939699:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788837551.939707:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788837551.939734:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788837551.939742:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788837551.939755:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788837551.939760:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788837551.939771:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788837551.940097:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788837551.940129:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788837551.940134:0:6519:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788837551.940141:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788837551.940318:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788837551.940328:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788837551.940345:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788837551.940361:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788837551.940390:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788837551.940401:0:6519:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788837551.940424:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788837551.940431:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788837551.940441:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788837551.940462:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788837551.940474:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788837551.940483:0:6519:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788837551.940504:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788837551.940511:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788837551.940522:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788837551.940536:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788837551.940596:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788837551.940619:0:6519:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788837551.940625:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788837551.941218:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788837551.941396:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788837551.941415:0:6519:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.103@tcp for mdt 20000000:01000000:3.0:1788837551.941417:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:3.0:1788837551.941429:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788837551.941433:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788837551.941444:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788837551.941448:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:3.0:1788837551.941458:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788837551.941465:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788837551.941477:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788837551.941491:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788837551.941514:0:6519:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788837551.941517:0:6519:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788837551.941521:0:6519:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788837551.941575:0:6519:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788837551.941578:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788837551.942032:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788837551.942242:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788837551.942263:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788837551.942292:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1788837551.942302:0:6519:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788837551.942304:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788837551.942628:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788837551.942981:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788837551.943001:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788837551.943018:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788837551.943028:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788837551.943031:0:6519:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788837551.943036:0:6519:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788837551.943038:0:6519:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788837551.943043:0:6519:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788837551.943049:0:6519:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788837551.943635:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788837551.943768:0:6519:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788837551.955676:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788837551.955712:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788837551.955745:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788837551.955766:0:6519:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788837551.955816:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003048600c/0x57f6d4e926aeeada lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837551.955833:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003048600c/0x57f6d4e926aeeada lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837551.955844:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003048600c/0x57f6d4e926aeeada lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837551.955850:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003048600c/0x57f6d4e926aeeada lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837551.955855:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003048600c/0x57f6d4e926aeeada lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837551.955862:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003048600c/0x57f6d4e926aeeada lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837551.955885:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003048600c already unused, calling callback (00000000e9b23507) 00010000:00010000:3.0:1788837551.955889:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003048600c/0x57f6d4e926aeeada lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837551.955897:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003048600c/0x57f6d4e926aeeada lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837551.955909:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003048600c/0x57f6d4e926aeeada lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837551.955915:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003048600c/0x57f6d4e926aeeada lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837551.955920:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003048600c/0x57f6d4e926aeeada lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788837551.955936:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788837551.964296:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a70a0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+5:6501:x1875732036845824:12345-0@lo:253: Request processed in 27591us (27872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837551.964316:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837551.964403:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036845824:0@lo:253: 10000000:01000000:0.0:1788837551.964418:0:6501:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788837551.964422:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788837551.964423:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837551.964424:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837551.964425:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788837551.964427:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837551.964428:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837551.964429:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837551.964430:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837551.964431:0:6501:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788837551.964432:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837551.964433:0:6501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788837551.964452:0:6501:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000087ce0877 from lustre-MDT0000 10000000:01000000:0.0:1788837551.964493:0:6501:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788837551.964496:0:6501:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788837551.964500:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff889ac85799b8 10000000:01000000:0.0:1788837551.964505:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788837551.964514:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff889ac85799b8 from 1 10000000:01000000:0.0:1788837551.964517:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788837551.964555:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837551.964565:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837551.964573:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837551.964590:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036845952:0@lo:101: 00000100:00100000:0.0:1788837551.964625:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837551.964699:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034261dc5 going to sleep for 11 seconds 00000100:00100000:1.0:1788837551.964744:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036845952 00000100:00100000:1.0:1788837551.964751:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036845952 00000100:00100000:1.0:1788837551.965098:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837551.965109:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e39c36e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+5:6501:x1875732036845952:12345-0@lo:101: 00010000:00010000:1.0:1788837551.965122:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837551.965138:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000383dde74/0x57f6d4e926aeeae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeae1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837551.965161:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000383dde74/0x57f6d4e926aeeae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeae1 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837551.965171:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000383dde74/0x57f6d4e926aeeae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeae1 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837551.965180:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000383dde74, rc 0) 00000100:00100000:1.0:1788837551.965242:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e39c36e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+6:6501:x1875732036845952:12345-0@lo:101: Request processed in 136us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837551.965248:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837551.965307:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036845952:0@lo:101: 00010000:00010000:0.0:1788837551.965320:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeae8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837551.965328:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeae8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837551.965377:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036846080:0@lo:501: 00000100:00100000:0.0:1788837551.965403:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837551.965515:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034261dc5 going to sleep for 11 seconds 00000100:00100000:2.0:1788837551.965585:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036846080 00000100:00100000:2.0:1788837551.965591:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036846080 00000100:00100000:2.0:1788837551.965613:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788837551.965619:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000049da5e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+6:6501:x1875732036846080:12345-0@lo:501: 00000100:00100000:2.0:1788837551.965707:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000049da5e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+6:6501:x1875732036846080:12345-0@lo:501: Request processed in 88us (303us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788837551.965714:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837551.965819:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036846080:0@lo:501: 10000000:01000000:0.0:1788837551.965857:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788837551.965886:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeae8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837551.965895:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeae8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837551.965902:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff889ac3ec4000 10000000:01000000:0.0:1788837551.965907:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788837551.965911:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff889ac3ec4000 10000000:01000000:0.0:1788837551.965913:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788837551.965916:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff889ac3ec4000 from 1 10000000:01000000:0.0:1788837551.965918:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788837551.965947:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000fd1b9481/0x57f6d4e926aeeaef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837551.965955:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000fd1b9481/0x57f6d4e926aeeaef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837551.965962:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000fd1b9481/0x57f6d4e926aeeaef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837551.965972:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036846208:0@lo:101: 00000100:00100000:0.0:1788837551.965998:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837551.966010:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034261dc5 going to sleep for 11 seconds 00000100:00100000:2.0:1788837551.966135:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036846208 00000100:00100000:2.0:1788837551.966140:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036846208 00000100:00100000:2.0:1788837551.966160:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837551.966165:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f78aa36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+6:6501:x1875732036846208:12345-0@lo:101: 00010000:00010000:2.0:1788837551.966172:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837551.966184:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a8a43799/0x57f6d4e926aeeaf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeaef expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837551.966197:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a8a43799/0x57f6d4e926aeeaf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeaef expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837551.966205:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a8a43799/0x57f6d4e926aeeaf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeaef expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837551.966212:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a8a43799, rc 0) 00000100:00100000:2.0:1788837551.966251:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f78aa36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+7:6501:x1875732036846208:12345-0@lo:101: Request processed in 86us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837551.966274:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837551.966408:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036846208:0@lo:101: 00010000:00010000:0.0:1788837551.966420:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000fd1b9481/0x57f6d4e926aeeaef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837551.966436:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000fd1b9481/0x57f6d4e926aeeaef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837551.966446:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788837551.966459:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000fd1b9481/0x57f6d4e926aeeaef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837551.966465:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 00000000fd1b9481/0x57f6d4e926aeeaef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837551.966471:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788837551.966473:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788837551.966477:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff889ac3ec4000 10000000:01000000:0.0:1788837551.966479:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788837551.966482:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788837551.966484:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788837551.966496:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837551.966502:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837551.966508:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837551.966518:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036846336:0@lo:101: 00000100:00100000:0.0:1788837551.966543:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837551.966560:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034261dc5 going to sleep for 11 seconds 00000100:00100000:2.0:1788837551.966618:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036846336 00000100:00100000:2.0:1788837551.966622:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036846336 00000100:00100000:2.0:1788837551.966638:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837551.966643:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4bef01d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+7:6501:x1875732036846336:12345-0@lo:101: 00010000:00010000:2.0:1788837551.966649:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837551.966655:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c54524f/0x57f6d4e926aeeb04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeafd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837551.966666:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c54524f/0x57f6d4e926aeeb04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeafd expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837551.966673:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c54524f/0x57f6d4e926aeeb04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeafd expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837551.966679:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c54524f, rc 0) 00000100:00100000:2.0:1788837551.966714:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4bef01d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+8:6501:x1875732036846336:12345-0@lo:101: Request processed in 71us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837551.966730:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788837551.966952:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036846336:0@lo:101: 00010000:00010000:0.0:1788837551.966962:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb04 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837551.966969:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeb04 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837551.967011:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036846464:0@lo:501: 00000100:00100000:0.0:1788837551.967037:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837551.967048:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034261dc5 going to sleep for 11 seconds 00000100:00100000:2.0:1788837551.967154:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036846464 00000100:00100000:2.0:1788837551.967159:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036846464 00000100:00100000:2.0:1788837551.967178:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837551.967184:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020ac984c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+8:6501:x1875732036846464:12345-0@lo:501: 00000100:00100000:2.0:1788837551.967282:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020ac984c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+9:6501:x1875732036846464:12345-0@lo:501: Request processed in 99us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837551.967288:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837551.967394:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036846464:0@lo:501: 00000100:00100000:0.0:1788837551.967418:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036846592:0@lo:503: 00000100:00100000:0.0:1788837551.967455:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837551.967483:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034261dc5 going to sleep for 11 seconds 00000100:00100000:2.0:1788837551.967523:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036846592 00000100:00100000:2.0:1788837551.967528:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036846592 00000100:00100000:2.0:1788837551.967553:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788837551.967557:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e389ea36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+9:6501:x1875732036846592:12345-0@lo:503: 00000100:00100000:2.0:1788837551.967639:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e389ea36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+9:6501:x1875732036846592:12345-0@lo:503: Request processed in 80us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837551.967645:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837551.967726:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036846592:0@lo:503: 00000100:00100000:0.0:1788837551.968399:0:6546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6546:1875732036846720:0@lo:502: 00000100:00100000:0.0:1788837551.968441:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837551.968475:0:6546:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c6abd800 going to sleep for 11 seconds 00000100:00100000:2.0:1788837551.968518:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036846720 00000100:00100000:2.0:1788837551.968523:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036846720 00000100:00100000:2.0:1788837551.968544:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788837551.968549:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d680f774 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+9:6546:x1875732036846720:12345-0@lo:502: 00000100:00100000:2.0:1788837551.968641:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d680f774 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+9:6546:x1875732036846720:12345-0@lo:502: Request processed in 91us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837551.968648:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788837551.968729:0:6546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6546:1875732036846720:0@lo:502: 00000020:01000000:0.0:1788837551.968756:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837551.968766:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837551.968769:0:6546:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788837551.968800:0:6546:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788837551.968812:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788837551.968828:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d67f6d9a) 00000020:00000080:0.0:1788837551.968846:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788837551.968857:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788837551.968956:0:6546:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788837551.968964:0:6546:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926aeeb12 00000020:00000080:0.0:1788837551.969195:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788837551.969201:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837551.969204:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837551.969206:0:6546:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788837551.969208:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837551.969212:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837551.969214:0:6546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788837551.969216:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788837551.969223:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000364fa94d) 00000020:00000080:0.0:1788837551.969232:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788837551.969236:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788837551.969237:0:6546:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788837551.969240:0:6546:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788837551.969245:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788837551.969280:0:6546:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000087ce0877 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788837551.969292:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d0faaadd) 00000020:00000080:0.0:1788837551.969299:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788837551.969363:0:6546:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788837551.969369:0:6546:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926aeeb27 00000020:00000080:0.0:1788837551.969472:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788837551.969478:0:6546:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788837551.969483:0:6546:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x57f6d4e926aeeb2e 00080000:01000000:0.0:1788837551.969488:0:6546:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788837551.969492:0:6546:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926aeeb35 00080000:10000000:0.0:1788837551.969932:0:6546:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788837551.970061:0:6546:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788837551.975421:0:6546:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788837552.081354:0:6546:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788837552.081768:0:6546:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788837552.084371:0:6546:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788837552.084696:0:6546:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788837552.088975:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004f97589e) 00000020:00000080:3.0:1788837552.089000:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788837552.089083:0:6546:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788837552.089177:0:6546:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926aeeb43 00000020:00000080:0.0:1788837552.090148:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788837552.091232:0:6546:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1788837552.094710:0:6546:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1788837552.107440:0:6546:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1788837552.112635:0:6546:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1788837552.116345:0:6546:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1788837552.119418:0:6546:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1788837552.122404:0:6546:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x57f6d4e926aeeb4a 00000020:00000080:2.0:1788837552.123109:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788837552.123124:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837552.123382:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837552.123385:0:6546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788837552.123390:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837552.123395:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837552.123396:0:6546:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788837552.123399:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788837552.123401:0:6546:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788837552.123403:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837552.123406:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837552.123407:0:6546:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788837552.123421:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837552.123426:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837552.123427:0:6546:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788837552.123432:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788837552.123479:0:6546:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788837552.123550:0:6546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd07f9d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6546:1875732036846848:0@lo:502: 00000100:00100000:2.0:1788837552.123632:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837552.123691:0:6546:0:(client.c:2715:ptlrpc_set_wait()) set 0000000014201030 going to sleep for 11 seconds 00000100:00100000:3.0:1788837552.123769:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036846848 00000100:00100000:3.0:1788837552.124336:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036846848 00000100:00100000:3.0:1788837552.124390:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837552.124399:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8cce5c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+9:6546:x1875732036846848:12345-0@lo:502: 00000100:00100000:3.0:1788837552.124532:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8cce5c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+9:6546:x1875732036846848:12345-0@lo:502: Request processed in 133us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837552.124540:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788837552.124664:0:6546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd07f9d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6546:1875732036846848:0@lo:502: 00000020:01000000:2.0:1788837552.124697:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837552.124704:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837552.124705:0:6546:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788837552.124709:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788837552.125386:0:6501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788837552.125411:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788837552.125431:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb04 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.125442:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb04 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837552.125450:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ac3ec4000 from 1 10000000:01000000:0.0:1788837552.125453:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788837552.125488:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.125495:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.125504:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837552.125522:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036846976:0@lo:101: 00000100:00100000:0.0:1788837552.125566:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837552.125690:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fd87c95 going to sleep for 11 seconds 00000100:00100000:3.0:1788837552.125740:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036846976 00000100:00100000:3.0:1788837552.125746:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036846976 00000100:00100000:3.0:1788837552.126305:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837552.126316:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008295dcac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+9:6501:x1875732036846976:12345-0@lo:101: 00010000:00010000:3.0:1788837552.126329:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837552.126344:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003048600c/0x57f6d4e926aeeb58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeb51 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837552.126368:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003048600c/0x57f6d4e926aeeb58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeb51 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837552.126378:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003048600c/0x57f6d4e926aeeb58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeb51 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837552.126385:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003048600c, rc 0) 00000100:00100000:3.0:1788837552.126436:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008295dcac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+10:6501:x1875732036846976:12345-0@lo:101: Request processed in 123us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837552.126442:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837552.126511:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036846976:0@lo:101: 00010000:00010000:0.0:1788837552.126528:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb58 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.126536:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeb58 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837552.127453:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036847104:0@lo:256: 00000100:00100000:0.0:1788837552.128471:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837552.129227:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036847104 00000100:00100000:2.0:1788837552.129237:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036847104 00000100:00100000:2.0:1788837552.129281:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837552.129289:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000147dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+10:6501:x1875732036847104:12345-0@lo:256: 20000000:01000000:2.0:1788837552.129311:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788837552.129316:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788837552.129391:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000147dc988 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+10:6501:x1875732036847104:12345-0@lo:256: Request processed in 102us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837552.129399:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788837552.129586:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fd87c95 going to sleep for 11 seconds 00000100:00100000:0.0:1788837552.129610:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036847104:0@lo:256: 10000000:01000000:0.0:1788837552.130595:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788837552.130615:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb58 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.130627:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb58 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837552.130636:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ac3ec4000 from 1 10000000:01000000:0.0:1788837552.130638:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837552.130670:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.130678:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.130687:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837552.130704:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036847232:0@lo:101: 00000100:00100000:0.0:1788837552.130763:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837552.131043:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fd87c95 going to sleep for 11 seconds 00000100:00100000:0.0:1788837552.131079:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036847232 00000100:00100000:0.0:1788837552.131086:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036847232 00000100:00100000:0.0:1788837552.131242:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788837552.131249:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004767698e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+10:6501:x1875732036847232:12345-0@lo:101: 00010000:00010000:0.0:1788837552.131261:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837552.131287:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000503a0260/0x57f6d4e926aeeb66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeb5f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.131325:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000503a0260/0x57f6d4e926aeeb66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeb5f expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.131335:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000503a0260/0x57f6d4e926aeeb66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeb5f expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.131344:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000503a0260, rc 0) 00000100:00100000:0.0:1788837552.131379:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004767698e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:6501:x1875732036847232:12345-0@lo:101: Request processed in 130us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837552.131385:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837552.131500:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c1d9dc07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036847232:0@lo:101: 00010000:00010000:1.0:1788837552.131516:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb66 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837552.131525:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeb66 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837552.131604:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060c06867 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036847360:0@lo:501: 00000100:00100000:1.0:1788837552.131634:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837552.131648:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 000000001599f527 going to sleep for 11 seconds 00000100:00100000:1.0:1788837552.132057:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036847360 00000100:00100000:1.0:1788837552.132062:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036847360 00000100:00100000:1.0:1788837552.132085:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788837552.132101:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a270f268 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:6501:x1875732036847360:12345-0@lo:501: 00000100:00100000:1.0:1788837552.132285:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a270f268 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:6501:x1875732036847360:12345-0@lo:501: Request processed in 195us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837552.132293:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788837552.132365:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060c06867 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036847360:0@lo:501: 00000100:00100000:1.0:1788837552.132392:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060c06867 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036847488:0@lo:503: 00000100:00100000:1.0:1788837552.132433:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837552.132454:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 000000001599f527 going to sleep for 11 seconds 00000100:00100000:1.0:1788837552.132467:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036847488 00000100:00100000:1.0:1788837552.132471:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036847488 00000100:00100000:1.0:1788837552.132488:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788837552.132493:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cad390a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:6501:x1875732036847488:12345-0@lo:503: 00000040:00080000:1.0:1788837552.132524:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788837552.132560:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cad390a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:6501:x1875732036847488:12345-0@lo:503: Request processed in 67us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837552.132567:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788837552.132606:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060c06867 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036847488:0@lo:503: 00000040:00080000:1.0:1788837552.137520:0:6550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788837552.138415:0:6501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788837552.138446:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837552.138463:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb66 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.138477:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb66 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837552.138541:0:6501:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788837552.138544:0:6501:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff889ac3ec4000 10000000:01000000:0.0:1788837552.138547:0:6501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff889ac3ec4000 10000000:01000000:0.0:1788837552.138551:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788837552.138557:0:6501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ac3ec4000 from 1 10000000:01000000:0.0:1788837552.138559:0:6501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788837552.138595:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.138604:0:6501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.138631:0:6501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837552.138654:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b267f687 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036847616:0@lo:101: 00000100:00100000:0.0:1788837552.139345:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837552.139384:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036847616 00000100:00100000:0.0:1788837552.139391:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036847616 00000100:00100000:0.0:1788837552.139444:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837552.139452:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c66766b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:6501:x1875732036847616:12345-0@lo:101: 00010000:00010000:0.0:1788837552.139467:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837552.139480:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091ac5c3b/0x57f6d4e926aeeb74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeb6d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.139502:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091ac5c3b/0x57f6d4e926aeeb74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeb6d expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.139511:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091ac5c3b/0x57f6d4e926aeeb74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeb6d expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.139519:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091ac5c3b, rc 0) 00000100:00100000:0.0:1788837552.139552:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c66766b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6501:x1875732036847616:12345-0@lo:101: Request processed in 100us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837552.139559:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837552.139607:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 000000001febb9e4 going to sleep for 11 seconds 00000100:00100000:0.0:1788837552.139629:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b267f687 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036847616:0@lo:101: 00010000:00010000:0.0:1788837552.139644:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb74 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.139679:0:6501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeb74 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837552.139759:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b267f687 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036847744:0@lo:501: 00000100:00100000:0.0:1788837552.140761:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837552.141201:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 000000001febb9e4 going to sleep for 11 seconds 00000100:00100000:3.0:1788837552.141365:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036847744 00000100:00100000:3.0:1788837552.141373:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036847744 00000100:00100000:3.0:1788837552.141450:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788837552.141458:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ab1aedb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6501:x1875732036847744:12345-0@lo:501: 00000100:00100000:3.0:1788837552.141607:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ab1aedb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6501:x1875732036847744:12345-0@lo:501: Request processed in 150us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837552.141630:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788837552.141705:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b267f687 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036847744:0@lo:501: 00000100:00100000:1.0:1788837552.141768:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060c06867 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036847872:0@lo:503: 00000100:00100000:1.0:1788837552.141851:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837552.144522:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034fd404b going to sleep for 11 seconds 00000100:00100000:3.0:1788837552.144572:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036847872 00000100:00100000:3.0:1788837552.144583:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036847872 00000100:00100000:3.0:1788837552.144642:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788837552.144652:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cc53efe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6501:x1875732036847872:12345-0@lo:503: 00000100:00100000:3.0:1788837552.145329:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cc53efe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6501:x1875732036847872:12345-0@lo:503: Request processed in 675us (3474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837552.145339:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788837552.145462:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060c06867 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036847872:0@lo:503: 00000100:00100000:3.0:1788837552.146323:0:6551:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbe64f32 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6551:1875732036848000:0@lo:502: 00000100:00100000:3.0:1788837552.146378:0:6551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837552.146417:0:6551:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9b3570f going to sleep for 11 seconds 00000100:00100000:1.0:1788837552.146520:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036848000 00000100:00100000:1.0:1788837552.146527:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036848000 00000100:00100000:1.0:1788837552.146568:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837552.146576:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b69ef94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6551:x1875732036848000:12345-0@lo:502: 00000100:00100000:1.0:1788837552.146684:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b69ef94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6551:x1875732036848000:12345-0@lo:502: Request processed in 108us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837552.146691:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788837552.146773:0:6551:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbe64f32 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6551:1875732036848000:0@lo:502: 00000020:01000004:2.0:1788837552.146878:0:6551:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788837552.146892:0:6551:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000002f7b7c91) 00000020:00000080:2.0:1788837552.146910:0:6551:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788837552.146995:0:6551:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000087ce0877 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788837552.146999:0:6551:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000087ce0877 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788837552.147008:0:6551:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000087ce0877 4 00010000:00080000:2.0:1788837552.147041:0:6551:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000961241a5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:2.0:1788837552.151381:0:6551:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788837552.151586:0:6551:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788837552.151628:0:6551:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788837552.151641:0:6551:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x57f6d4e926aeeb82 00000100:00080000:2.0:1788837552.151651:0:6551:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837552.151656:0:6551:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000961241a5 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837552.151690:0:6551:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fd07f9d4 x1875732036848128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837552.151767:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd07f9d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732036848128:0@lo:38: 00000100:00100000:3.0:1788837552.151885:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837552.153243:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036848128 00000100:00100000:2.0:1788837552.153255:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036848128 00000100:00100000:2.0:1788837552.153298:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837552.153305:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a8bba96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875732036848128:12345-0@lo:38: 00000100:00100000:2.0:1788837552.155363:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a8bba96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875732036848128:12345-0@lo:38: Request processed in 2051us (3472us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788837552.155377:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788837552.155418:0:6551:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788837552.158767:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837552.159274:0:3647:0:(import.c:65:import_set_state_nolock()) 00000000961241a5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837552.159283:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788837552.159288:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd07f9d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732036848128:0@lo:38: 00000100:00100000:0.0:1788837552.159443:0:6551:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d5bb7443 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6551:1875732036848256:0@lo:502: 00000100:00100000:0.0:1788837552.159515:0:6551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837552.159548:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036848256 00000100:00100000:0.0:1788837552.159555:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036848256 00000100:00100000:0.0:1788837552.159615:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788837552.159623:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ef54355 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6551:x1875732036848256:12345-0@lo:502: 00000100:00100000:0.0:1788837552.159738:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ef54355 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6551:x1875732036848256:12345-0@lo:502: Request processed in 115us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837552.159744:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788837552.160016:0:6551:0:(client.c:2715:ptlrpc_set_wait()) set 000000004dfeef3b going to sleep for 11 seconds 00000100:00100000:0.0:1788837552.160034:0:6551:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d5bb7443 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6551:1875732036848256:0@lo:502: 00000040:00080000:0.0:1788837552.160055:0:6551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788837552.160430:0:6501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788837552.160451:0:6501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788837552.160462:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb74 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837552.160473:0:6501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb74 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788837552.160513:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788837552.160515:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788837552.160517:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837552.160518:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837552.160519:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837552.160520:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837552.160521:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837552.160523:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788837552.160524:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837552.160525:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837552.160526:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837552.160530:0:6501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788837552.160533:0:6501:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788837552.160535:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788837552.160536:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788837552.160537:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837552.160538:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837552.160539:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837552.160540:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837552.160541:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837552.160542:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788837552.160543:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837552.160544:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837552.160545:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837552.160545:0:6501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788837552.160559:0:6501:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788837552.160568:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060c06867 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036848384:0@lo:253: 00000100:00100000:1.0:1788837552.160602:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837552.160621:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set 000000001599f527 going to sleep for 11 seconds 00000100:00100000:3.0:1788837552.161647:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036848384 00000100:00100000:3.0:1788837552.161657:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036848384 00000100:00100000:3.0:1788837552.161721:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788837552.161731:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce32f715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6501:x1875732036848384:12345-0@lo:253: 20000000:01000000:3.0:1788837552.161762:0:6519:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788837552.161814:0:6519:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788837552.168310:0:6519:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788837552.168327:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788837552.168646:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce32f715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6501:x1875732036848384:12345-0@lo:253: Request processed in 6913us (8039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837552.168659:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788837552.168742:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060c06867 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6501:1875732036848384:0@lo:253: 10000000:01000000:1.0:1788837552.168755:0:6501:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788837552.168758:0:6501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788837552.168760:0:6501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788837552.168761:0:6501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837552.168763:0:6501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837552.168764:0:6501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837552.168765:0:6501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837552.168767:0:6501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837552.168768:0:6501:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788837552.168770:0:6501:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837552.168771:0:6501:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837552.168772:0:6501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837552.169023:0:6501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788837552.169038:0:6501:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788837552.177069:0:6540:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788837552.177081:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788837552.177246:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837552.177282:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003048600c/0x57f6d4e926aeeb58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeb51 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837552.177290:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837552.177768:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003048600c/0x57f6d4e926aeeb58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeeb51 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837552.178237:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003048600c/0x57f6d4e926aeeb58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb51 expref: 11 pid: 6519 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837552.178253:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000efeab4ee pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875732036848512:0@lo:104: 00080000:10000000:1.0:1788837552.182677:0:6501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788837552.183442:0:6501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788837552.183675:0:6501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:2.0:1788837552.183973:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837552.184032:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9b3570f going to sleep for 11 seconds 00000100:00100000:3.0:1788837552.184287:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036848512 00000100:00100000:3.0:1788837552.184297:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036848512 00000100:00100000:3.0:1788837552.184362:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837552.184371:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d98f5967 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6540:x1875732036848512:12345-0@lo:104: 00010000:00010000:3.0:1788837552.184387:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeb58 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837552.184448:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837552.184453:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d98f5967 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6540:x1875732036848512:12345-0@lo:104: Request processed in 85us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837552.184460:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837552.184831:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000efeab4ee pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875732036848512:0@lo:104: 00010000:00010000:2.0:1788837552.184864:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788837552.185544:0:6501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788837552.186268:0:6501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788837552.186480:0:6501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:3.0:1788837552.186634:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837552.186642:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeb58 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837552.186665:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000134faf7a already unused, calling callback (0000000091ee5375) 10000000:00010000:3.0:1788837552.186669:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeeb58 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837552.186677:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeeb58 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837552.186683:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeeb58 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837552.186688:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837552.186748:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb58 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837552.186756:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837552.186817:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb58 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837552.186823:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeeb51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb58 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837552.186843:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837552.186845:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837552.186847:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837552.187485:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837552.187504:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000666f80f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036848640:0@lo:103: 00000100:00100000:1.0:1788837552.187568:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:3.0:1788837552.188705:0:6501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1788837552.189033:0:6501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788837552.189537:0:6501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1788837552.189724:0:6501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788837552.190602:0:6501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1788837552.191587:0:6501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00000100:00100000:2.0:1788837552.192703:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036848640 00000100:00100000:2.0:1788837552.192731:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036848640 00010000:00010000:2.0:1788837552.192766:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003048600c/0x57f6d4e926aeeb58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb51 expref: 12 pid: 6519 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837552.192866:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837552.192875:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060c06867 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:3648:x1875732036848640:12345-0@lo:103: 00010000:00010000:2.0:1788837552.192890:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837552.192895:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003048600c/0x57f6d4e926aeeb58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb51 expref: 12 pid: 6519 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837552.192905:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003048600c/0x57f6d4e926aeeb58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb51 expref: 12 pid: 6519 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837552.192931:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003048600c/0x57f6d4e926aeeb58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeeb51 expref: 12 pid: 6519 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837552.192944:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837552.192951:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788837552.192966:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015886511s 00010000:00010000:2.0:1788837552.192969:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837552.192975:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837552.192980:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837552.192986:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837552.192996:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c6c0fb46 already unused, calling callback (00000000e9b23507) 00010000:00010000:2.0:1788837552.193000:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837552.193006:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837552.193022:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837552.193032:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837552.193125:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060c06867 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:3648:x1875732036848640:12345-0@lo:103: Request processed in 251us (5556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837552.193497:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837552.193566:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000666f80f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036848640:0@lo:103: 00010000:00010000:0.0:1788837552.194073:0:6540:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.194084:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837552.194100:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c6c0fb46/0x57f6d4e926aeeb89 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 40000000:02000000:3.0:1788837552.198675:0:6501:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788837552.212609:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788837552.212883:0:6557:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788837552.213939:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788837552.214074:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788837552.214463:0:6501:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788837552.214469:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788837552.214553:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837552.215468:0:6501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:3.0:1788837552.216137:0:6556:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788837552.216143:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1788837552.216979:0:6501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788837552.217044:0:6501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788837552.218404:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788837552.218647:0:6501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1788837552.219763:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788837552.219998:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788837552.220609:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788837552.220768:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000040:00080000:2.0:1788837552.222073:0:6557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1788837552.222665:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000040:00080000:2.0:1788837552.228743:0:6557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788837552.229051:0:6557:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788837552.229057:0:6557:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1788837552.229579:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788837552.229830:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788837552.230417:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788837552.230558:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788837552.230706:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788837552.231080:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788837552.231403:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788837552.231543:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788837552.231666:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788837552.232055:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788837552.234268:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788837552.235415:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788837552.235595:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788837552.235746:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788837552.236202:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788837552.236412:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788837552.236579:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788837552.236738:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788837552.237310:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788837552.237670:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788837552.237998:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788837552.238220:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788837552.238413:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788837552.238557:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788837552.238735:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788837552.238897:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788837552.239301:0:6501:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788837552.239661:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788837552.243599:0:6501:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788837552.243639:0:6501:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3bc81c97988 00100000:10000000:0.0:1788837552.243647:0:6501:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788837552.244564:0:6501:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788837552.244580:0:6501:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788837552.244600:0:6501:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788837552.244618:0:6501:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788837552.248291:0:6501:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788837552.250846:0:6501:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788837552.827839:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837553.848930:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837554.874834:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837555.899090:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837556.921173:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788837557.177565:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788837557.177572:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788837557.177575:0:38:0:(import.c:65:import_set_state_nolock()) 00000000961241a5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837557.177587:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000961241a5 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837557.177607:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009a91118e x1875732036848896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788837557.177701:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837557.177725:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000403a1ccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036848768:0@lo:400: 00000100:00100000:2.0:1788837557.178121:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837557.178193:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732036848896:0@lo:38: 00000100:00100000:2.0:1788837557.178227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837557.178331:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036848896 00000100:00100000:1.0:1788837557.178340:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036848896 00000100:00100000:1.0:1788837557.178383:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837557.178389:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004524847e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875732036848896:12345-0@lo:38: 00010000:00080000:1.0:1788837557.178417:0:6526:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:1.0:1788837557.178453:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x57f6d4e926aeeb90 00000004:00100000:1.0:1788837557.178499:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788837557.178644:0:6526:0:(import.c:65:import_set_state_nolock()) 00000000e2fb3678 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837557.178695:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004524847e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875732036848896:12345-0@lo:38: Request processed in 305us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837557.178702:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837557.178934:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036848768 00000100:00100000:0.0:1788837557.178951:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036848768 00000100:00100000:0.0:1788837557.178987:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788837557.178993:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc92a10b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:3651:x1875732036848768:12345-0@lo:400: 00000100:00100000:0.0:1788837557.179033:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc92a10b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:3651:x1875732036848768:12345-0@lo:400: Request processed in 42us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837557.179040:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788837557.179324:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009a91118e x1875732036848896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788837557.179340:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788837557.179346:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788837557.179351:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788837557.179353:0:3647:0:(import.c:65:import_set_state_nolock()) 00000000961241a5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788837557.179360:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732036848896:0@lo:38: 00000100:00100000:2.0:1788837557.179395:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000403a1ccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036848768:0@lo:400: 00000001:02000400:1.0:1788837557.391431:0:6802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788837557.945453:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788837558.567630:0:6854:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788837558.568095:0:6854:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788837558.971465:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837559.992981:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837561.032757:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788837561.272858:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788837561.272867:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ac3ec4000 from 3 10000000:01000000:1.0:1788837561.272872:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788837561.272988:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837561.273002:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837561.273013:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837561.273038:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae61bbfc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036849024:0@lo:101: 00000100:00100000:1.0:1788837561.273126:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837561.273197:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 000000007c967030 going to sleep for 11 seconds 00000100:00100000:3.0:1788837561.277403:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036849024 00000100:00100000:3.0:1788837561.277422:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036849024 00000100:00100000:3.0:1788837561.277495:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837561.277505:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042e83973 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:6521:x1875732036849024:12345-0@lo:101: 00010000:00010000:3.0:1788837561.277596:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837561.277616:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000080f3283f/0x57f6d4e926aeeb9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeb97 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837561.277644:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080f3283f/0x57f6d4e926aeeb9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeb97 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837561.277656:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000080f3283f/0x57f6d4e926aeeb9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeb97 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837561.277665:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000080f3283f, rc 0) 00000100:00100000:3.0:1788837561.277746:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042e83973 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6521:x1875732036849024:12345-0@lo:101: Request processed in 243us (4620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837561.277753:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788837561.277841:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae61bbfc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036849024:0@lo:101: 00010000:00010000:1.0:1788837561.277859:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837561.277869:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeb9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837561.277944:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae61bbfc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036849152:0@lo:256: 00000100:00100000:1.0:1788837561.277986:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837561.278020:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 000000007c967030 going to sleep for 11 seconds 00000100:00100000:2.0:1788837561.278152:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036849152 00000100:00100000:2.0:1788837561.278160:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036849152 00000100:00100000:2.0:1788837561.278205:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788837561.278212:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fc04312 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6521:x1875732036849152:12345-0@lo:256: 20000000:01000000:2.0:1788837561.278235:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788837561.278253:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788837561.278256:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788837561.278334:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fc04312 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6521:x1875732036849152:12345-0@lo:256: Request processed in 123us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837561.278341:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837561.278438:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae61bbfc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036849152:0@lo:256: 10000000:01000000:3.0:1788837561.278484:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788837561.278491:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837561.278499:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeb9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1788837561.846515:0:6955:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788837561.847317:0:6955:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788837562.040960:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837562.297305:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837562.297331:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c7f9d9d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036849280:0@lo:400: 00000100:00100000:3.0:1788837562.297400:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837562.297621:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036849280 00000100:00100000:1.0:1788837562.297630:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036849280 00000100:00100000:1.0:1788837562.297690:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788837562.297699:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b96e54cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:3650:x1875732036849280:12345-0@lo:400: 00000100:00100000:1.0:1788837562.297798:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b96e54cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:3650:x1875732036849280:12345-0@lo:400: Request processed in 79us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837562.297807:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837562.298008:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c7f9d9d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036849280:0@lo:400: 00000100:00100000:0.0:1788837562.298106:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084e7e743 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036849408:0@lo:400: 00000100:00100000:0.0:1788837562.298144:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837562.298286:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036849408 00000100:00100000:2.0:1788837562.298291:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036849408 00000100:00100000:2.0:1788837562.298328:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837562.298334:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5bb7443 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036849408:12345-0@lo:400: 00000100:00100000:2.0:1788837562.298381:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5bb7443 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036849408:12345-0@lo:400: Request processed in 48us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837562.298393:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788837562.298464:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000084e7e743 x1875732036849408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837562.298477:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084e7e743 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036849408:0@lo:400: 00010000:00010000:1.0:1788837563.065981:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837564.089976:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837565.115904:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837566.137878:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837567.168428:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837567.416970:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a381d41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036849664:0@lo:400: 00000100:00100000:3.0:1788837567.417078:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837567.417127:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd96aa53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036849536:0@lo:400: 00000100:00100000:0.0:1788837567.417168:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837567.417226:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036849536 00000100:00100000:0.0:1788837567.417234:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036849536 00000100:00100000:0.0:1788837567.417284:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837567.417293:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017f3260e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:3649:x1875732036849536:12345-0@lo:400: 00000100:00100000:0.0:1788837567.417341:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017f3260e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:3649:x1875732036849536:12345-0@lo:400: Request processed in 50us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837567.417350:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837567.417392:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd96aa53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036849536:0@lo:400: 00000100:00100000:1.0:1788837567.418325:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036849664 00000100:00100000:1.0:1788837567.418333:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036849664 00000100:00100000:1.0:1788837567.419158:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837567.419173:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3903f45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036849664:12345-0@lo:400: 00000100:00100000:1.0:1788837567.419276:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3903f45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036849664:12345-0@lo:400: Request processed in 108us (2199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837567.419283:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788837567.419361:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006a381d41 x1875732036849664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837567.419400:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a381d41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036849664:0@lo:400: 00010000:00010000:0.0:1788837568.194590:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837569.210453:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837570.234588:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837571.256971:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837572.288403:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837572.541675:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837572.541708:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025b0dc2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036849792:0@lo:400: 00000100:00100000:0.0:1788837572.541845:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837572.541946:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036849792 00000100:00100000:0.0:1788837572.541955:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036849792 00000100:00100000:0.0:1788837572.542014:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837572.542022:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005876ed0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:3650:x1875732036849792:12345-0@lo:400: 00000100:00100000:0.0:1788837572.542074:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005876ed0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:3650:x1875732036849792:12345-0@lo:400: Request processed in 52us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837572.542081:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837572.542129:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025b0dc2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036849792:0@lo:400: 00000100:00100000:2.0:1788837572.542456:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b547a14f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036849920:0@lo:400: 00000100:00100000:2.0:1788837572.542490:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837572.545154:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036849920 00000100:00100000:0.0:1788837572.545168:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036849920 00000100:00100000:0.0:1788837572.545236:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837572.545245:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000403a1ccb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036849920:12345-0@lo:400: 00000100:00100000:0.0:1788837572.548357:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000403a1ccb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036849920:12345-0@lo:400: Request processed in 3104us (5857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837572.548385:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788837572.557140:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b547a14f x1875732036849920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837572.557163:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b547a14f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036849920:0@lo:400: 00010000:00010000:1.0:1788837573.304974:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788837574.036940:0:7454:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788837574.036946:0:7454:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788837574.036947:0:7454:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788837574.037095:0:7454:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000004471f5df 00000020:01000004:2.0:1788837574.037113:0:7454:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788837574.037123:0:7454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788837574.037137:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000005565e7d1) 00000020:00000080:2.0:1788837574.037152:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788837574.092211:0:7454:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788837574.092366:0:7454:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788837574.121439:0:7454:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788837574.121968:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788837574.121979:0:7454:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788837574.121993:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926aeebac 00000020:01000004:2.0:1788837574.121999:0:7454:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788837574.122021:0:7454:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788837574.122024:0:7454:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788837574.122030:0:7454:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788837574.122055:0:7454:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788837574.122059:0:7454:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788837574.140766:0:7454:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788837574.140897:0:7454:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.103@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1788837574.140902:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788837574.140903:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788837574.140905:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837574.140906:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837574.140907:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837574.140908:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837574.140909:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788837574.140910:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788837574.140911:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788837574.140913:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837574.140914:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788837574.140917:0:7454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1788837574.140919:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788837574.140925:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788837574.140926:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837574.140927:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837574.140928:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837574.140928:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837574.140929:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788837574.140930:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788837574.140931:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788837574.140931:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837574.140932:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788837574.140968:0:7454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788837574.140985:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3bbf6f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036850048:0@lo:253: 00000100:00100000:3.0:1788837574.141052:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837574.141145:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b62e208 going to sleep for 11 seconds 00000100:00100000:1.0:1788837574.141190:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036850048 00000100:00100000:1.0:1788837574.141198:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036850048 00000100:00100000:1.0:1788837574.141251:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837574.141259:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000636ae8ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:7454:x1875732036850048:12345-0@lo:253: 20000000:01000000:1.0:1788837574.141289:0:6519:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788837574.141292:0:6519:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1788837574.141297:0:6519:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1788837574.141301:0:6519:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1788837574.141345:0:6519:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1788837574.141732:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837574.142089:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788837574.142105:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788837574.142123:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788837574.142139:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788837574.142169:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788837574.142227:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1788837574.142234:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1788837574.142244:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1788837574.142248:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1788837574.142257:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1788837574.142261:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1788837574.142272:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788837574.142286:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788837574.142411:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1788837574.142421:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:1.0:1788837574.142434:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1788837574.142440:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788837574.142451:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1788837574.142455:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:1.0:1788837574.142465:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1788837574.142469:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788837574.142479:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788837574.142492:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788837574.142695:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788837574.142772:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1788837574.142903:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1788837574.142920:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788837574.142938:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788837574.142956:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1788837574.142963:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1788837574.142976:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788837574.142992:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788837574.142996:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1788837574.143016:0:6519:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788837574.143030:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788837574.143388:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788837574.143751:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788837574.143772:0:6519:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.103@tcp for mdt 20000000:01000000:1.0:1788837574.143887:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:1.0:1788837574.143908:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788837574.143916:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788837574.143928:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788837574.143934:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:1.0:1788837574.143950:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788837574.143957:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1788837574.143969:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1788837574.143984:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1788837574.144026:0:6519:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1788837574.144035:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1788837574.144344:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1788837574.144673:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788837574.144695:0:6519:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.201.103@tcp for mdt 20000000:01000000:1.0:1788837574.144697:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:1.0:1788837574.144716:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788837574.144722:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788837574.144737:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788837574.144742:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:1.0:1788837574.144753:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788837574.144758:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1788837574.144770:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788837574.144911:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1788837574.144931:0:6519:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788837574.144934:0:6519:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788837574.144938:0:6519:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788837574.145005:0:6519:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788837574.145008:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788837574.145317:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788837574.145346:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788837574.145363:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1788837574.145505:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788837574.145525:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788837574.145733:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1788837574.145746:0:6519:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788837574.145748:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788837574.146391:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788837574.146416:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788837574.146431:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788837574.146897:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788837574.146920:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788837574.146945:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788837574.146955:0:6519:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788837574.146957:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788837574.147298:0:7464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788837574.147318:0:7464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788837574.147344:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788837574.147690:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1788837574.147715:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1788837574.147731:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1788837574.147744:0:6519:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788837574.147746:0:6519:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788837574.147751:0:6519:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788837574.147760:0:6519:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788837574.148152:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1788837574.148264:0:6519:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788837574.157659:0:6519:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788837574.158345:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.158379:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000383dde74/0x57f6d4e926aeeae8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeae1 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.158385:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003c54524f/0x57f6d4e926aeeb04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeafd expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.158390:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000091ac5c3b/0x57f6d4e926aeeb74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeb6d expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.158397:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.158437:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000091ac5c3b/0x57f6d4e926aeeb74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeeb6d expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.158452:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000091ac5c3b/0x57f6d4e926aeeb74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb6d expref: 12 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837574.158467:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a9a1601 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875732036850176:0@lo:104: 00000100:00100000:0.0:1788837574.158747:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837574.158829:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003c54524f/0x57f6d4e926aeeb04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeeafd expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.158839:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003c54524f/0x57f6d4e926aeeb04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeeafd expref: 12 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837574.158848:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c100226a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875732036850304:0@lo:104: 00000100:00100000:0.0:1788837574.158871:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837574.158903:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036850176 00000100:00100000:0.0:1788837574.158916:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036850176 00000100:00100000:0.0:1788837574.158955:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036850304 00000100:00100000:0.0:1788837574.158958:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036850304 00000100:00100000:0.0:1788837574.158971:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837574.158978:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb636e83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6519:x1875732036850176:12345-0@lo:104: 00010000:00010000:0.0:1788837574.158989:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeb74 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.159032:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837574.159037:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb636e83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6519:x1875732036850176:12345-0@lo:104: Request processed in 60us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.159043:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837574.159059:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837574.159064:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001405667e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6519:x1875732036850304:12345-0@lo:104: 00010000:00010000:0.0:1788837574.159070:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeb04 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.159099:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788837574.159104:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001405667e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6519:x1875732036850304:12345-0@lo:104: Request processed in 41us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.159109:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788837574.159125:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837574.159129:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeb74 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.159136:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c3abdd3d already unused, calling callback (0000000091ee5375) 10000000:00010000:0.0:1788837574.159139:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeeb74 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.159157:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeeb74 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837574.159164:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeeb74 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837574.159169:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837574.159197:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb74 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.159203:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837574.159220:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb74 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.159226:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 00000000c3abdd3d/0x57f6d4e926aeeb6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb74 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.159238:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837574.159241:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeb04 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.159245:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000041aedea4 already unused, calling callback (0000000091ee5375) 10000000:00010000:0.0:1788837574.159247:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeeb04 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.159252:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeeb04 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837574.159257:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeeb04 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837574.159267:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837574.159278:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb04 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.159284:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837574.159298:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb04 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.159305:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 0000000041aedea4/0x57f6d4e926aeeafd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb04 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.159313:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837574.159314:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837574.159315:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837574.159320:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837574.159351:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023c01dfc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036850432:0@lo:103: 00000100:00100000:0.0:1788837574.159378:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837574.159411:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005655a8ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036850560:0@lo:103: 00000100:00100000:0.0:1788837574.159431:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837574.159464:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036850432 00000100:00100000:0.0:1788837574.159468:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036850432 00010000:00010000:0.0:1788837574.159483:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000091ac5c3b/0x57f6d4e926aeeb74 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb6d expref: 13 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837574.159515:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036850560 00000100:00100000:0.0:1788837574.159519:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036850560 00010000:00010000:0.0:1788837574.159527:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003c54524f/0x57f6d4e926aeeb04 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeafd expref: 14 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837574.159850:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837574.159858:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b945a657 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:3649:x1875732036850432:12345-0@lo:103: 00010000:00010000:0.0:1788837574.159869:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837574.159873:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000091ac5c3b/0x57f6d4e926aeeb74 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb6d expref: 14 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.159882:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000091ac5c3b/0x57f6d4e926aeeb74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb6d expref: 14 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.159898:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837574.159972:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b945a657 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:3649:x1875732036850432:12345-0@lo:103: Request processed in 116us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.159979:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837574.159993:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837574.159999:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002039f0b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:3650:x1875732036850560:12345-0@lo:103: 00010000:00010000:0.0:1788837574.160006:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837574.160009:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003c54524f/0x57f6d4e926aeeb04 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeafd expref: 13 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160016:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003c54524f/0x57f6d4e926aeeb04 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeeafd expref: 13 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160026:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837574.160052:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002039f0b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:3650:x1875732036850560:12345-0@lo:103: Request processed in 54us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.160058:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837574.160096:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005655a8ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036850560:0@lo:103: 00010000:00010000:0.0:1788837574.160136:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000383dde74/0x57f6d4e926aeeae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeeae1 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160145:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000383dde74/0x57f6d4e926aeeae8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeeae1 expref: 12 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837574.160153:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005655a8ae pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875732036850688:0@lo:104: 00000100:00100000:0.0:1788837574.160177:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837574.160195:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036850688 00000100:00100000:0.0:1788837574.160199:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036850688 00000100:00100000:0.0:1788837574.160224:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837574.160229:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082f1157a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6519:x1875732036850688:12345-0@lo:104: 00010000:00010000:0.0:1788837574.160237:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeae8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160267:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837574.160272:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082f1157a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6519:x1875732036850688:12345-0@lo:104: Request processed in 43us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.160277:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788837574.160292:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837574.160295:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeae8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160302:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000021f8aafa already unused, calling callback (0000000091ee5375) 10000000:00010000:0.0:1788837574.160304:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeeae8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160311:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeeae8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837574.160326:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeeae8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837574.160342:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837574.160363:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeae8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160369:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837574.160379:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeae8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160384:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 0000000021f8aafa/0x57f6d4e926aeeae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeae8 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160399:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837574.160400:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837574.160401:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837574.160414:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a71ca545 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036850816:0@lo:103: 00000100:00100000:0.0:1788837574.160438:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837574.160464:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036850816 00000100:00100000:0.0:1788837574.160467:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036850816 00010000:00010000:0.0:1788837574.160482:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000383dde74/0x57f6d4e926aeeae8 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeae1 expref: 13 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837574.160513:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837574.160519:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eac9752d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:3651:x1875732036850816:12345-0@lo:103: 00010000:00010000:0.0:1788837574.160526:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837574.160529:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000383dde74/0x57f6d4e926aeeae8 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeae1 expref: 13 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160874:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000383dde74/0x57f6d4e926aeeae8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeeae1 expref: 13 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160888:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160894:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160907:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160913:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160919:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160924:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160929:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006c19f838 already unused, calling callback (00000000e9b23507) 00010000:00010000:0.0:1788837574.160932:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160939:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160946:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.160965:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837574.160993:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eac9752d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:3651:x1875732036850816:12345-0@lo:103: Request processed in 475us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.160999:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837574.161027:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000762ae62d going to sleep for 11 seconds 00010000:00010000:0.0:1788837574.161042:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000091ac5c3b/0x57f6d4e926aeeb74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeeb6d expref: 12 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837574.161053:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a9a1601 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875732036850176:0@lo:104: 00010000:00010000:0.0:1788837574.161061:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003c54524f/0x57f6d4e926aeeb04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeeafd expref: 11 pid: 6516 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837574.161069:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c100226a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875732036850304:0@lo:104: 00010000:00010000:0.0:1788837574.161075:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000383dde74/0x57f6d4e926aeeae8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeeae1 expref: 10 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837574.161083:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005655a8ae pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6519:1875732036850688:0@lo:104: 00010000:00010000:0.0:1788837574.161099:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.161108:0:6519:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.161112:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.161118:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006c19f838/0x57f6d4e926aeebb3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788837574.161144:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788837574.161745:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a71ca545 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036850816:0@lo:103: 00000100:00100000:2.0:1788837574.162840:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023c01dfc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036850432:0@lo:103: 00000100:00100000:1.0:1788837574.163586:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000636ae8ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+9:7454:x1875732036850048:12345-0@lo:253: Request processed in 22317us (22523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837574.163600:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788837574.164167:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3bbf6f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036850048:0@lo:253: 10000000:01000000:0.0:1788837574.164184:0:7454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788837574.164187:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788837574.164189:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788837574.164190:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837574.164191:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788837574.164192:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837574.164193:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837574.164195:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837574.164196:0:7454:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788837574.164197:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837574.164199:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788837574.164216:0:7454:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004471f5df from lustre-MDT0001 10000000:01000000:0.0:1788837574.164247:0:7454:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788837574.164250:0:7454:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788837574.164257:0:7454:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff889ac85799b8 local copy 10000000:01000000:0.0:1788837574.164261:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788837574.164293:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.164304:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.164312:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837574.164329:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005655a8ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036850944:0@lo:101: 00000100:00100000:0.0:1788837574.164383:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837574.164417:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 000000000840c25c going to sleep for 11 seconds 00000100:00100000:1.0:1788837574.164479:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036850944 00000100:00100000:1.0:1788837574.164486:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036850944 00000100:00100000:1.0:1788837574.164641:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837574.164651:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e501b5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+9:7454:x1875732036850944:12345-0@lo:101: 00010000:00010000:1.0:1788837574.164665:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837574.164690:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069b26122/0x57f6d4e926aeebc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeebba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837574.164717:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069b26122/0x57f6d4e926aeebc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeebba expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837574.164725:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069b26122/0x57f6d4e926aeebc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeebba expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837574.164733:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069b26122, rc 0) 00000100:00100000:1.0:1788837574.164799:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e501b5ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+10:7454:x1875732036850944:12345-0@lo:101: Request processed in 151us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837574.164806:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788837574.164883:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005655a8ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036850944:0@lo:101: 00010000:00010000:2.0:1788837574.164902:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x57f6d4e926aeebc1 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.164910:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x57f6d4e926aeebc1 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837574.165012:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036851072:0@lo:501: 00000100:00100000:2.0:1788837574.165038:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.165355:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d5ee73d0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837574.165385:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036851072 00000100:00100000:0.0:1788837574.165396:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036851072 00000100:00100000:0.0:1788837574.165418:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788837574.165423:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067ecc024 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+10:7454:x1875732036851072:12345-0@lo:501: 00000100:00100000:0.0:1788837574.165640:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067ecc024 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+10:7454:x1875732036851072:12345-0@lo:501: Request processed in 66us (451us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788837574.165649:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788837574.165742:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036851072:0@lo:501: 10000000:01000000:2.0:1788837574.165755:0:7454:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788837574.165772:0:7454:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788837574.165927:0:7454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x57f6d4e926aeebc1 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.165935:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x57f6d4e926aeebc1 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.165941:0:7454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x57f6d4e926aeebc1 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.165955:0:7454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788837574.165976:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff889ae7d4b000 10000000:01000000:2.0:1788837574.165980:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788837574.165985:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff889ac85799b8 10000000:01000000:2.0:1788837574.165987:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788837574.165989:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff889ac85799b8 from 1 10000000:01000000:2.0:1788837574.165992:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788837574.166010:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 000000006323518b/0x57f6d4e926aeebc8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.166022:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 000000006323518b/0x57f6d4e926aeebc8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.166029:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 000000006323518b/0x57f6d4e926aeebc8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837574.166040:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036851200:0@lo:101: 00000100:00100000:2.0:1788837574.166065:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.166082:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aba4c2a7 going to sleep for 11 seconds 00010000:00010000:0.0:1788837574.166514:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837574.166520:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x57f6d4e926aeebc1 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.166527:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000134faf7a already unused, calling callback (0000000091ee5375) 10000000:00010000:0.0:1788837574.166530:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x57f6d4e926aeebc1 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.166705:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x57f6d4e926aeebc1 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837574.166714:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x57f6d4e926aeebc1 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837574.166719:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837574.166739:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x57f6d4e926aeebc1 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.166746:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837574.166812:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x57f6d4e926aeebc1 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.166819:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeebba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x57f6d4e926aeebc1 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.166845:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837574.166847:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837574.166848:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837574.166861:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036851200 00000100:00100000:0.0:1788837574.166865:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036851200 00000100:00100000:0.0:1788837574.166897:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788837574.166904:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000662a9314 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+10:7454:x1875732036851200:12345-0@lo:101: 00010000:00010000:0.0:1788837574.166913:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837574.166927:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000328e7498/0x57f6d4e926aeebcf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeebc8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.166949:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000328e7498/0x57f6d4e926aeebcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeebc8 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.166960:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000328e7498/0x57f6d4e926aeebcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeebc8 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.166967:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000328e7498, rc 0) 00000100:00100000:0.0:1788837574.167007:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000662a9314 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:7454:x1875732036851200:12345-0@lo:101: Request processed in 103us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.167014:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788837574.167091:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c100226a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036851328:0@lo:103: 00000100:00100000:2.0:1788837574.167126:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.167184:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036851200:0@lo:101: 00010000:00010000:2.0:1788837574.167195:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 000000006323518b/0x57f6d4e926aeebc8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeebcf expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.167202:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 000000006323518b/0x57f6d4e926aeebc8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeebcf expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837574.167219:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788837574.167227:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 000000006323518b/0x57f6d4e926aeebc8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeebcf expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.167233:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 000000006323518b/0x57f6d4e926aeebc8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeebcf expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837574.167242:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff889ae7d4b000 10000000:01000000:2.0:1788837574.167246:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788837574.167255:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff889ae7d4b000 from 1 10000000:01000000:2.0:1788837574.167258:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788837574.167273:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 0000000048d333ad/0x57f6d4e926aeebd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.167279:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 0000000048d333ad/0x57f6d4e926aeebd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.167285:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 0000000048d333ad/0x57f6d4e926aeebd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837574.167296:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036851456:0@lo:101: 00000100:00100000:2.0:1788837574.167320:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.167341:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aba4c2a7 going to sleep for 11 seconds 00000100:00100000:0.0:1788837574.167719:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036851328 00000100:00100000:0.0:1788837574.167725:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036851328 00000100:00100000:0.0:1788837574.167768:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837574.167795:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a141737 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:3648:x1875732036851328:12345-0@lo:103: 00010000:00010000:0.0:1788837574.167806:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837574.167819:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000069b26122/0x57f6d4e926aeebc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aeebba expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.167839:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837574.167873:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a141737 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+10:3648:x1875732036851328:12345-0@lo:103: Request processed in 99us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.167880:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837574.167916:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c100226a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036851328:0@lo:103: 00000100:00100000:0.0:1788837574.167933:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036851456 00000100:00100000:0.0:1788837574.167935:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036851456 00000100:00100000:0.0:1788837574.167950:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788837574.167954:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba1213ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+10:7454:x1875732036851456:12345-0@lo:101: 00010000:00010000:0.0:1788837574.167963:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837574.167971:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008477395b/0x57f6d4e926aeebdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeebd6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.167985:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008477395b/0x57f6d4e926aeebdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeebd6 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.167991:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008477395b/0x57f6d4e926aeebdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeebd6 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.167997:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008477395b, rc 0) 00000100:00100000:0.0:1788837574.168021:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba1213ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:7454:x1875732036851456:12345-0@lo:101: Request processed in 67us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.168027:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788837574.168166:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036851456:0@lo:101: 00010000:00010000:2.0:1788837574.168177:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 0000000048d333ad/0x57f6d4e926aeebd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.168186:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 0000000048d333ad/0x57f6d4e926aeebd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837574.168197:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788837574.168211:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 0000000048d333ad/0x57f6d4e926aeebd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.168217:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 0000000048d333ad/0x57f6d4e926aeebd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837574.168222:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788837574.168226:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837574.168238:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff889ae7d4b000 10000000:01000000:2.0:1788837574.168240:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788837574.168243:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788837574.168245:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788837574.168261:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000856dc28b/0x57f6d4e926aeebe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.168268:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000856dc28b/0x57f6d4e926aeebe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.168273:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000856dc28b/0x57f6d4e926aeebe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837574.168285:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036851584:0@lo:101: 00000100:00100000:2.0:1788837574.168311:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.168376:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aba4c2a7 going to sleep for 11 seconds 00000100:00100000:1.0:1788837574.168429:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036851584 00000100:00100000:1.0:1788837574.168434:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036851584 00000100:00100000:1.0:1788837574.168466:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788837574.168473:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037397e06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:7454:x1875732036851584:12345-0@lo:101: 00010000:00010000:1.0:1788837574.168479:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837574.168487:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000018f8a0b5/0x57f6d4e926aeebeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeebe4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837574.168512:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000018f8a0b5/0x57f6d4e926aeebeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeebe4 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837574.168519:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000018f8a0b5/0x57f6d4e926aeebeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeebe4 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837574.168525:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000018f8a0b5, rc 0) 00000100:00100000:1.0:1788837574.168566:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037397e06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:7454:x1875732036851584:12345-0@lo:101: Request processed in 95us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837574.168580:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788837574.168827:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036851584:0@lo:101: 00010000:00010000:2.0:1788837574.168837:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000856dc28b/0x57f6d4e926aeebe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeebeb expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.168843:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000856dc28b/0x57f6d4e926aeebe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeebeb expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837574.168933:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036851712:0@lo:501: 00000100:00100000:2.0:1788837574.168959:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.168987:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aba4c2a7 going to sleep for 11 seconds 00000100:00100000:2.0:1788837574.169321:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036851712 00000100:00100000:2.0:1788837574.169328:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036851712 00000100:00100000:2.0:1788837574.169376:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788837574.169382:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6a8c927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:7454:x1875732036851712:12345-0@lo:501: 00000100:00100000:2.0:1788837574.169511:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6a8c927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:7454:x1875732036851712:12345-0@lo:501: Request processed in 129us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837574.169518:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788837574.169768:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036851712:0@lo:501: 00000100:00100000:2.0:1788837574.169841:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036851840:0@lo:503: 00000100:00100000:2.0:1788837574.169877:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.169887:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aba4c2a7 going to sleep for 11 seconds 00000100:00100000:2.0:1788837574.169905:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036851840 00000100:00100000:2.0:1788837574.169908:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036851840 00000100:00100000:2.0:1788837574.169925:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788837574.169929:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018032ba3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:7454:x1875732036851840:12345-0@lo:503: 00000100:00100000:2.0:1788837574.170004:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018032ba3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:7454:x1875732036851840:12345-0@lo:503: Request processed in 74us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837574.170011:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788837574.170045:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036851840:0@lo:503: 00000040:00080000:2.0:1788837574.170272:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788837574.170351:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036851968:0@lo:502: 00000100:00100000:2.0:1788837574.170383:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.170391:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aba4c2a7 going to sleep for 11 seconds 00000100:00100000:2.0:1788837574.170411:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036851968 00000100:00100000:2.0:1788837574.170414:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036851968 00000100:00100000:2.0:1788837574.170441:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788837574.170447:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006e99caa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:7454:x1875732036851968:12345-0@lo:502: 00000100:00100000:2.0:1788837574.170532:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006e99caa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:7454:x1875732036851968:12345-0@lo:502: Request processed in 84us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837574.171006:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788837574.171042:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036851968:0@lo:502: 00000040:00080000:2.0:1788837574.171232:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788837574.171259:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1788837574.171273:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1788837574.171284:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1788837574.171297:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1788837574.171307:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1788837574.171319:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1788837574.171346:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1788837574.171361:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1788837574.171375:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1788837574.171388:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1788837574.171400:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1788837574.171412:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1788837574.171424:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1788837574.171436:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1788837574.171448:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1788837574.171463:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1788837574.171699:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1788837574.171724:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1788837574.171737:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1788837574.171749:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1788837574.171760:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1788837574.171771:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1788837574.171897:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036852096:0@lo:502: 00000100:00100000:2.0:1788837574.171949:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.172025:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aba4c2a7 going to sleep for 11 seconds 00000100:00100000:2.0:1788837574.172052:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036852096 00000100:00100000:2.0:1788837574.172058:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036852096 00000100:00100000:0.0:1788837574.172360:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788837574.172372:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fffa3260 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:7454:x1875732036852096:12345-0@lo:502: 00000100:00100000:0.0:1788837574.172489:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fffa3260 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:7454:x1875732036852096:12345-0@lo:502: Request processed in 121us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.172510:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788837574.172670:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a91118e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036852096:0@lo:502: 00000040:00080000:1.0:1788837574.172728:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788837574.172737:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1788837574.173354:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837574.173378:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837574.173381:0:7466:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788837574.173387:0:7466:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788837574.173390:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788837574.173412:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000006379d00c) 00000020:00000080:1.0:1788837574.173431:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1788837574.173437:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788837574.173519:0:7466:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788837574.173542:0:7466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926aeebf9 00000020:00000080:1.0:1788837574.173761:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788837574.173766:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837574.173769:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837574.173770:0:7466:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788837574.173773:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837574.173808:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837574.173809:0:7466:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788837574.173813:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788837574.173820:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000de2d3a01) 00000020:00000080:1.0:1788837574.173831:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1788837574.173835:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788837574.173837:0:7466:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788837574.173839:0:7466:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788837574.173846:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788837574.173945:0:7466:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004471f5df from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788837574.173958:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000007ef4a6f9) 00000020:00000080:1.0:1788837574.173966:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1788837574.174027:0:7466:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788837574.174033:0:7466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926aeec0e 00000020:00000080:1.0:1788837574.174139:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788837574.174145:0:7466:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788837574.174150:0:7466:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x57f6d4e926aeec15 00080000:01000000:1.0:1788837574.174155:0:7466:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788837574.174157:0:7466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926aeec1c 00080000:10000000:1.0:1788837574.174574:0:7466:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788837574.174695:0:7466:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1788837574.316662:0:7466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1788837574.316954:0:7466:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788837574.319381:0:7466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788837574.319716:0:7466:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:2.0:1788837574.330340:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788837574.333653:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788837574.333669:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837574.333675:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837574.333678:0:7466:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788837574.333682:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837574.333688:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837574.333690:0:7466:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788837574.333693:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788837574.333698:0:7466:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:00000080:1.0:1788837574.333728:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788837574.333742:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000aedfbda0) 00000020:00000080:1.0:1788837574.333764:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788837574.333769:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788837574.333862:0:7466:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788837574.333868:0:7466:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788837574.333875:0:7466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926aeec2a 00010000:00080000:1.0:1788837574.333908:0:7466:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000eed1f46c@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:1.0:1788837574.340268:0:7466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1788837574.344343:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788837574.344360:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788837574.344398:0:7466:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788837574.344431:0:7466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926aeec31 00000100:00080000:0.0:1788837574.344441:0:7466:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788837574.344446:0:7466:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000eed1f46c using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788837574.344479:0:7466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c100226a x1875732036852224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788837574.344506:0:7466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788837574.344572:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837574.344577:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837574.344579:0:7466:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788837574.344582:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788837574.344585:0:7466:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788837574.344586:0:7466:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788837574.344588:0:7466:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788837574.344589:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788837574.344592:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837574.344593:0:7466:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788837574.344595:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837574.344600:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837574.344601:0:7466:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788837574.344605:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788837574.344635:0:7466:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788837574.344647:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837574.344650:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837574.344652:0:7466:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788837574.344654:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837574.344656:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837574.344664:0:7466:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788837574.344668:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788837574.344669:0:7466:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788837574.344696:0:7466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837574.344699:0:7466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837574.344700:0:7466:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788837574.344703:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1788837574.344762:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1788837574.344834:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788837574.344850:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000856dc28b/0x57f6d4e926aeebe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeebeb expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.344861:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 00000000856dc28b/0x57f6d4e926aeebe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeebeb expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837574.344869:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ae7d4b000 from 1 10000000:01000000:0.0:1788837574.344872:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788837574.344901:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.344908:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.344919:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837574.344939:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a9a1601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036852352:0@lo:101: 00000100:00100000:0.0:1788837574.345014:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837574.345063:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012226af1 going to sleep for 11 seconds 00000100:00100000:0.0:1788837574.345093:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036852352 00000100:00100000:0.0:1788837574.345100:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036852352 00000100:00100000:0.0:1788837574.345147:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788837574.345155:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000898141eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:7454:x1875732036852352:12345-0@lo:101: 00010000:00010000:0.0:1788837574.345168:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837574.345179:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000022e39343/0x57f6d4e926aeec3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeec38 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.345201:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022e39343/0x57f6d4e926aeec3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeec38 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.345210:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000022e39343/0x57f6d4e926aeec3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeec38 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.345217:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000022e39343, rc 0) 00000100:00100000:0.0:1788837574.345252:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000898141eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:7454:x1875732036852352:12345-0@lo:101: Request processed in 98us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.345259:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788837574.345300:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a9a1601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036852352:0@lo:101: 00010000:00010000:0.0:1788837574.345313:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec3f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.345321:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeec3f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837574.345896:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a9a1601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036852480:0@lo:256: 00000100:00100000:0.0:1788837574.345937:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837574.345958:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012226af1 going to sleep for 11 seconds 00000100:00100000:0.0:1788837574.345980:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036852480 00000100:00100000:0.0:1788837574.345985:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036852480 00000100:00100000:0.0:1788837574.346010:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788837574.346842:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074c6cf45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:7454:x1875732036852480:12345-0@lo:256: 20000000:01000000:0.0:1788837574.346868:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788837574.346886:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788837574.346889:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788837574.346991:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074c6cf45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:7454:x1875732036852480:12345-0@lo:256: Request processed in 155us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.346999:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788837574.347066:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a9a1601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036852480:0@lo:256: 00000100:00100000:2.0:1788837574.347573:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c100226a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732036852224:0@lo:38: 00000100:00100000:2.0:1788837574.347619:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837574.347854:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036852224 00000100:00100000:3.0:1788837574.347859:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036852224 00000100:00100000:3.0:1788837574.347882:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837574.347896:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5c9eb92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875732036852224:12345-0@lo:38: 00010000:00080000:3.0:1788837574.347917:0:6529:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:3.0:1788837574.347965:0:6529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926aeec46 00000004:00100000:3.0:1788837574.347982:0:6529:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788837574.347989:0:6529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788837574.348699:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aad03c93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036852608:0@lo:400: 00000100:00100000:2.0:1788837574.348744:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837574.348847:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036852608 00000100:00100000:3.0:1788837574.348852:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036852608 00000100:00100000:3.0:1788837574.348890:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837574.348897:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089f19aae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036852608:12345-0@lo:400: 00000100:00100000:3.0:1788837574.348939:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089f19aae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036852608:12345-0@lo:400: Request processed in 43us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837574.348946:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788837574.349019:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000aad03c93 x1875732036852608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837574.349034:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aad03c93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036852608:0@lo:400: 10000000:01000000:0.0:1788837574.351251:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788837574.351280:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec3f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.351294:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec3f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837574.351302:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ae7d4b000 from 1 10000000:01000000:0.0:1788837574.351305:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837574.351356:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.351364:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.351374:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837574.351397:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a9a1601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036852736:0@lo:101: 00000100:00100000:0.0:1788837574.351467:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837574.351502:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012226af1 going to sleep for 11 seconds 00000100:00100000:0.0:1788837574.351546:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036852736 00000100:00100000:0.0:1788837574.351553:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036852736 00000100:00100000:0.0:1788837574.351594:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788837574.351602:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f332f0d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:7454:x1875732036852736:12345-0@lo:101: 00010000:00010000:0.0:1788837574.351614:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837574.351625:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c8ef0ae3/0x57f6d4e926aeec54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeec4d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.351647:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c8ef0ae3/0x57f6d4e926aeec54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeec4d expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.351658:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c8ef0ae3/0x57f6d4e926aeec54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeec4d expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.351665:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c8ef0ae3, rc 0) 00000100:00100000:0.0:1788837574.351698:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f332f0d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:7454:x1875732036852736:12345-0@lo:101: Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.351705:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788837574.351749:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a9a1601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036852736:0@lo:101: 00010000:00010000:0.0:1788837574.351763:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec54 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.351770:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeec54 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837574.351892:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a9a1601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036852864:0@lo:501: 00000100:00100000:0.0:1788837574.351915:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837574.351926:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012226af1 going to sleep for 11 seconds 00000100:00100000:2.0:1788837574.352191:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036852864 00000100:00100000:2.0:1788837574.352200:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036852864 00000100:00100000:2.0:1788837574.352223:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788837574.352228:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d86e79c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:7454:x1875732036852864:12345-0@lo:501: 00000100:00100000:2.0:1788837574.352321:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d86e79c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:7454:x1875732036852864:12345-0@lo:501: Request processed in 93us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837574.352340:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837574.352430:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a9a1601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036852864:0@lo:501: 00000100:00100000:0.0:1788837574.352469:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a9a1601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036852992:0@lo:503: 00000100:00100000:0.0:1788837574.352506:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837574.352575:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012226af1 going to sleep for 11 seconds 00000100:00080000:3.0:1788837574.354376:0:6529:0:(import.c:65:import_set_state_nolock()) 0000000084d0cbdc : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837574.354631:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788837574.354640:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788837574.354649:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788837574.354655:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788837574.354664:0:3647:0:(import.c:65:import_set_state_nolock()) 00000000eed1f46c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788837574.354679:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c100226a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732036852224:0@lo:38: 00000100:00100000:3.0:1788837574.354732:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5c9eb92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875732036852224:12345-0@lo:38: Request processed in 6834us (7112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837574.354741:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837574.354887:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077405e2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036853120:0@lo:41: 00000100:00100000:1.0:1788837574.354924:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837574.355056:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036853120 00000100:00100000:3.0:1788837574.355063:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036853120 00000100:00100000:3.0:1788837574.355097:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837574.355104:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079015bec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875732036853120:12345-0@lo:41: 00000004:00000024:3.0:1788837574.355128:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788837574.355507:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036852992 00000100:00100000:2.0:1788837574.355513:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036852992 00000100:00100000:2.0:1788837574.355729:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788837574.355738:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007621c225 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:7454:x1875732036852992:12345-0@lo:503: 00000040:00080000:2.0:1788837574.355813:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788837574.355861:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007621c225 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:7454:x1875732036852992:12345-0@lo:503: Request processed in 125us (3355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837574.355867:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837574.355969:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a9a1601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036852992:0@lo:503: 00000040:00080000:0.0:1788837574.356242:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837574.356296:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1788837574.356386:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837574.361316:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1788837574.362176:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788837574.362209:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837574.362232:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec54 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.362263:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec54 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837574.362318:0:7454:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788837574.362321:0:7454:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff889ae7d4b000 10000000:01000000:2.0:1788837574.362324:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff889ae7d4b000 10000000:01000000:2.0:1788837574.362337:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837574.362342:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ae7d4b000 from 1 10000000:01000000:2.0:1788837574.362345:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788837574.362380:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000760cdd72/0x57f6d4e926aeec5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.362387:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000760cdd72/0x57f6d4e926aeec5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.362397:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000760cdd72/0x57f6d4e926aeec5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837574.362429:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083c3e1bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036853248:0@lo:101: 00000100:00100000:2.0:1788837574.362495:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837574.362731:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036853248 00000100:00100000:0.0:1788837574.362740:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036853248 00000100:00100000:0.0:1788837574.362807:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788837574.362816:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f10f12f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:7454:x1875732036853248:12345-0@lo:101: 00010000:00010000:0.0:1788837574.362830:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837574.362844:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000311f8852/0x57f6d4e926aeec62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeec5b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.362865:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000311f8852/0x57f6d4e926aeec62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeec5b expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.362874:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000311f8852/0x57f6d4e926aeec62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeec5b expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.362882:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000311f8852, rc 0) 00000100:00100000:0.0:1788837574.362917:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f10f12f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:7454:x1875732036853248:12345-0@lo:101: Request processed in 103us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.362923:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788837574.363057:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000691be407 going to sleep for 11 seconds 00000100:00100000:2.0:1788837574.363082:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083c3e1bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036853248:0@lo:101: 00010000:00010000:2.0:1788837574.363095:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000760cdd72/0x57f6d4e926aeec5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec62 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.363103:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000760cdd72/0x57f6d4e926aeec5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeec62 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837574.363205:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083c3e1bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036853376:0@lo:501: 00000100:00100000:2.0:1788837574.363228:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.363256:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000691be407 going to sleep for 11 seconds 00000100:00100000:2.0:1788837574.363271:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036853376 00000100:00100000:2.0:1788837574.363275:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036853376 00000100:00100000:2.0:1788837574.363297:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788837574.363303:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000201f8740 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:7454:x1875732036853376:12345-0@lo:501: 00000100:00100000:2.0:1788837574.363406:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000201f8740 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:7454:x1875732036853376:12345-0@lo:501: Request processed in 103us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837574.364194:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788837574.364264:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083c3e1bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036853376:0@lo:501: 00000100:00100000:2.0:1788837574.364297:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083c3e1bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036853504:0@lo:503: 00000100:00100000:2.0:1788837574.364359:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.364385:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000691be407 going to sleep for 11 seconds 00000100:00100000:2.0:1788837574.364400:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036853504 00000100:00100000:2.0:1788837574.364404:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036853504 00000100:00100000:2.0:1788837574.365695:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788837574.365706:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008476bb9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:7454:x1875732036853504:12345-0@lo:503: 00000100:00100000:2.0:1788837574.365861:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008476bb9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:7454:x1875732036853504:12345-0@lo:503: Request processed in 157us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837574.365868:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788837574.365935:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083c3e1bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036853504:0@lo:503: 00000040:00080000:2.0:1788837574.366224:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788837574.366312:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083c3e1bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036853632:0@lo:502: 00000100:00100000:2.0:1788837574.366369:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.366399:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000691be407 going to sleep for 11 seconds 00000100:00100000:0.0:1788837574.366675:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036853632 00000100:00100000:0.0:1788837574.366681:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036853632 00000100:00100000:0.0:1788837574.366712:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788837574.366718:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095641937 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:7454:x1875732036853632:12345-0@lo:502: 00000100:00100000:0.0:1788837574.366827:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095641937 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:7454:x1875732036853632:12345-0@lo:502: Request processed in 110us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837574.366834:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788837574.367001:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079015bec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875732036853120:12345-0@lo:41: Request processed in 11897us (12076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837574.367011:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837574.367119:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077405e2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036853120:0@lo:41: 00000100:00100000:0.0:1788837574.367910:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083c3e1bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036853632:0@lo:502: 00000040:00080000:0.0:1788837574.368150:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788837574.368181:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788837574.368193:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788837574.368204:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788837574.368216:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788837574.368229:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788837574.368241:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788837574.368253:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788837574.368265:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788837574.368277:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788837574.368290:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788837574.368304:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788837574.368318:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788837574.368341:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788837574.368357:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788837574.368369:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788837574.368381:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788837574.368392:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788837574.368403:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788837574.368427:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788837574.368442:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788837574.368454:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788837574.368466:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788837574.368479:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788837574.368493:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788837574.368515:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788837574.368527:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788837574.368672:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788837574.368710:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a9a1601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036853760:0@lo:502: 00000100:00100000:0.0:1788837574.368809:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837574.368851:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 0000000020dede74 going to sleep for 11 seconds 00000100:00100000:1.0:1788837574.369181:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036853760 00000100:00100000:1.0:1788837574.369189:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036853760 00000100:00100000:1.0:1788837574.369237:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788837574.369246:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015f35017 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:7454:x1875732036853760:12345-0@lo:502: 00000100:00100000:1.0:1788837574.369390:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015f35017 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:7454:x1875732036853760:12345-0@lo:502: Request processed in 145us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837574.369398:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788837574.369685:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a9a1601 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036853760:0@lo:502: 00000040:00080000:3.0:1788837574.369744:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788837574.369754:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788837574.370745:0:7472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788837574.370761:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000004f357e) 00000020:00000080:3.0:1788837574.370813:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788837574.370892:0:7472:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004471f5df from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788837574.370897:0:7472:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004471f5df from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788837574.370899:0:7472:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004471f5df 3 00010000:00080000:3.0:1788837574.370935:0:7472:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000517af3c1@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788837574.373711:0:7472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1788837574.374165:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788837574.374207:0:7472:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788837574.374218:0:7472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x57f6d4e926aeec70 00000100:00080000:3.0:1788837574.374228:0:7472:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788837574.374233:0:7472:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000517af3c1 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837574.374267:0:7472:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f39530b9 x1875732036853888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837574.374295:0:7472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788837574.374383:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f39530b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875732036853888:0@lo:38: 00000100:00100000:1.0:1788837574.374471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837574.374584:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036853888 00000100:00100000:3.0:1788837574.374593:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036853888 00000100:00100000:3.0:1788837574.374632:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837574.374639:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b69b076f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875732036853888:12345-0@lo:38: 00010000:00080000:3.0:1788837574.374660:0:6526:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:3.0:1788837574.374703:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x57f6d4e926aeec77 00000004:00100000:3.0:1788837574.374730:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788837574.374759:0:6526:0:(import.c:65:import_set_state_nolock()) 00000000e19fd8a9 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837574.374843:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b69b076f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875732036853888:12345-0@lo:38: Request processed in 203us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837574.374850:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788837574.374892:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f39530b9 x1875732036853888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837574.374906:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837574.374913:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788837574.374920:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788837574.374923:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788837574.374925:0:3647:0:(import.c:65:import_set_state_nolock()) 00000000517af3c1 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788837574.374930:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f39530b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875732036853888:0@lo:38: 00000040:00080000:2.0:1788837574.376059:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:3.0:1788837574.376254:0:7473:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:1.0:1788837574.376373:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788837574.376405:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788837574.376434:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000760cdd72/0x57f6d4e926aeec5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec62 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837574.376444:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 00000000760cdd72/0x57f6d4e926aeec5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec62 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788837574.376491:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788837574.376494:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788837574.376495:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837574.376495:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837574.376496:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837574.376498:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837574.376503:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837574.376504:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837574.376505:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837574.376506:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837574.376507:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788837574.376510:0:7454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1788837574.376512:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788837574.376513:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788837574.376514:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837574.376515:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837574.376516:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837574.376516:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837574.376517:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837574.376518:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837574.376518:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837574.376519:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837574.376520:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788837574.376556:0:7454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788837574.376572:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c0651165 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036854016:0@lo:253: 00000100:00100000:1.0:1788837574.376627:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837574.376671:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f101bd0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837574.376796:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036854016 00000100:00100000:3.0:1788837574.376804:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036854016 00000100:00100000:3.0:1788837574.376852:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788837574.376860:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d0d09d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:7454:x1875732036854016:12345-0@lo:253: 20000000:01000000:3.0:1788837574.376880:0:6519:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788837574.376894:0:6519:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788837574.384843:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788837574.384978:0:6519:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788837574.384993:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788837574.385104:0:6540:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788837574.385109:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788837574.385129:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.385150:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000080f3283f/0x57f6d4e926aeeb9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeb97 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.385156:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000022e39343/0x57f6d4e926aeec3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeec38 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.385161:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.385199:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000022e39343/0x57f6d4e926aeec3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeec38 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.385212:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000022e39343/0x57f6d4e926aeec3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeec38 expref: 15 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837574.385226:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc6a7bc3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875732036854144:0@lo:104: 00000100:00100000:2.0:1788837574.385294:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837574.385360:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000080f3283f/0x57f6d4e926aeeb9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeeb97 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.385368:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000080f3283f/0x57f6d4e926aeeb9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb97 expref: 15 pid: 6519 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837574.385401:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fecce8cd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875732036854272:0@lo:104: 00000100:00100000:2.0:1788837574.385439:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.385457:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e9f2522 going to sleep for 11 seconds 00000100:00100000:1.0:1788837574.385685:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036854144 00000100:00100000:1.0:1788837574.385694:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036854144 00000100:00100000:1.0:1788837574.385731:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036854272 00000100:00100000:1.0:1788837574.385734:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036854272 00000100:00100000:1.0:1788837574.385746:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837574.385753:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab3d316c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6540:x1875732036854144:12345-0@lo:104: 00010000:00010000:1.0:1788837574.385765:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeec3f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837574.385852:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788837574.385858:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab3d316c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6540:x1875732036854144:12345-0@lo:104: Request processed in 106us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837574.385875:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837574.385892:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837574.385899:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a17a0f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6540:x1875732036854272:12345-0@lo:104: 00010000:00010000:1.0:1788837574.385906:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeb9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837574.385938:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788837574.385942:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a17a0f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6540:x1875732036854272:12345-0@lo:104: Request processed in 46us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837574.385949:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788837574.386025:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837574.386031:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeec3f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386039:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d89ac32e already unused, calling callback (0000000091ee5375) 10000000:00010000:2.0:1788837574.386041:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeec3f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386048:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeec3f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837574.386054:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeec3f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837574.386060:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788837574.386098:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec3f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386104:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837574.386122:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec3f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386128:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 00000000d89ac32e/0x57f6d4e926aeec38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec3f expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386142:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837574.386150:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeb9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386156:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000037ab2f23 already unused, calling callback (0000000091ee5375) 10000000:00010000:2.0:1788837574.386157:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeeb9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386163:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeeb9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837574.386167:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeeb9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837574.386172:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788837574.386184:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386189:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837574.386202:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386207:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeeb97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb9e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386231:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837574.386233:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837574.386234:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837574.386246:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000307b9bc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036854400:0@lo:103: 00000100:00100000:2.0:1788837574.386275:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.386312:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837574.386319:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0cacc6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036854528:0@lo:103: 00000100:00100000:2.0:1788837574.386370:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.386398:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036854400 00000100:00100000:2.0:1788837574.386402:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036854400 00010000:00010000:2.0:1788837574.386431:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000022e39343/0x57f6d4e926aeec3f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeec38 expref: 16 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837574.386450:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036854528 00000100:00100000:2.0:1788837574.386453:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036854528 00010000:00010000:2.0:1788837574.386463:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000080f3283f/0x57f6d4e926aeeb9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb97 expref: 17 pid: 6519 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837574.386475:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837574.386480:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a0e3f79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:3651:x1875732036854400:12345-0@lo:103: 00010000:00010000:2.0:1788837574.386490:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837574.386495:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000022e39343/0x57f6d4e926aeec3f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeec38 expref: 17 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386503:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000022e39343/0x57f6d4e926aeec3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeec38 expref: 17 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386519:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837574.386557:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a0e3f79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:3651:x1875732036854400:12345-0@lo:103: Request processed in 77us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837574.386564:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837574.386576:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837574.386582:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004543cc5c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:3649:x1875732036854528:12345-0@lo:103: 00010000:00010000:2.0:1788837574.386588:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837574.386591:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000080f3283f/0x57f6d4e926aeeb9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb97 expref: 16 pid: 6519 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386608:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000080f3283f/0x57f6d4e926aeeb9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb97 expref: 16 pid: 6519 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386619:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386627:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788837574.386640:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015886511s 00010000:00010000:2.0:1788837574.386644:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386650:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386655:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386660:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386665:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f38add32 already unused, calling callback (00000000e9b23507) 00010000:00010000:2.0:1788837574.386669:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386674:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386681:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386699:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837574.386724:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004543cc5c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:3649:x1875732036854528:12345-0@lo:103: Request processed in 143us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837574.386730:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837574.386853:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000307b9bc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036854400:0@lo:103: 00000100:00100000:2.0:1788837574.386877:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0cacc6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036854528:0@lo:103: 00010000:00010000:2.0:1788837574.386903:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000022e39343/0x57f6d4e926aeec3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeec38 expref: 15 pid: 6518 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837574.386916:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc6a7bc3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875732036854144:0@lo:104: 00010000:00010000:2.0:1788837574.386925:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000080f3283f/0x57f6d4e926aeeb9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeeb97 expref: 14 pid: 6519 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837574.386932:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fecce8cd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875732036854272:0@lo:104: 00010000:00010000:2.0:1788837574.386946:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386956:0:6540:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386961:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837574.386966:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f38add32/0x57f6d4e926aeec7e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837574.387492:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837574.388020:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d0d09d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:7454:x1875732036854016:12345-0@lo:253: Request processed in 11158us (11390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837574.388039:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788837574.388136:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c0651165 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7454:1875732036854016:0@lo:253: 10000000:01000000:1.0:1788837574.388149:0:7454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788837574.388152:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788837574.388154:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788837574.388155:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837574.388157:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837574.388158:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837574.388159:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837574.388160:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837574.388161:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837574.388162:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837574.388163:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837574.388165:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788837574.388180:0:7454:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788837574.398156:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1788837574.398344:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788837574.398531:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788837574.398707:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788837574.398910:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788837574.399063:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788837574.400846:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788837574.401097:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788837574.401274:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1788837574.401444:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788837574.401630:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1788837574.401823:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1788837574.406980:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788837574.407058:0:7477:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788837574.407062:0:7477:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788837574.407201:0:7478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1788837574.407257:0:7478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb63bde9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7478:1875732036854656:0@lo:700: 00000100:00100000:0.0:1788837574.407346:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837574.407398:0:7478:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b06b8fa going to sleep for 11 seconds 00000040:01000000:1.0:1788837574.407575:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788837574.408267:0:7479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c0651165 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875732036854784:0@lo:1000: 00000100:00100000:2.0:1788837574.408304:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036854656 00000100:00100000:1.0:1788837574.408311:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.408312:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036854656 00000100:00100000:1.0:1788837574.408351:0:7479:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efba8172 going to sleep for 11 seconds 00000100:00100000:2.0:1788837574.408365:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837574.408373:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae0e905c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7478:x1875732036854656:12345-0@lo:700: 00000040:01000000:0.0:1788837574.408931:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788837574.409135:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788837574.409545:0:7454:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788837574.409563:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788837574.409687:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788837574.409876:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036854784 00000100:00100000:1.0:1788837574.409883:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036854784 00000100:00100000:1.0:1788837574.409934:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837574.409952:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002faf9043 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875732036854784:12345-0@lo:1000: 00000100:00100000:1.0:1788837574.410055:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002faf9043 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875732036854784:12345-0@lo:1000: Request processed in 114us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837574.410062:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837574.410235:0:7479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c0651165 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875732036854784:0@lo:1000: 00000040:01000000:2.0:1788837574.410264:0:7479:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788837574.410292:0:7479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fecce8cd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875732036854912:0@lo:700: 00000100:00100000:2.0:1788837574.410322:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.410358:0:7479:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061a16abf going to sleep for 11 seconds 00000100:00100000:3.0:1788837574.410768:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036854912 00000100:00100000:3.0:1788837574.410796:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036854912 00000100:00100000:2.0:1788837574.410843:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837574.410851:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc6a7bc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+5:7479:x1875732036854912:12345-0@lo:700: 00000100:00100000:2.0:1788837574.410905:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc6a7bc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+5:7479:x1875732036854912:12345-0@lo:700: Request processed in 54us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837574.410911:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837574.410958:0:7479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fecce8cd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875732036854912:0@lo:700: 00000100:00100000:1.0:1788837574.411005:0:7479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a7ee85c7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7479:1875732036855040:0@lo:900: 00000100:00100000:1.0:1788837574.411032:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837574.411057:0:7479:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031c507a4 going to sleep for 11 seconds 00000100:00100000:2.0:1788837574.411070:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036855040 00000100:00100000:2.0:1788837574.411073:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036855040 00000100:00100000:2.0:1788837574.411105:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837574.411111:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c14ca2f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7479:x1875732036855040:12345-0@lo:900: 00000100:00100000:2.0:1788837574.411158:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c14ca2f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7479:x1875732036855040:12345-0@lo:900: Request processed in 47us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837574.411164:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788837574.411188:0:7479:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a7ee85c7 x1875732036855040/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788837590 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837574.411199:0:7479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a7ee85c7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7479:1875732036855040:0@lo:900: 00000100:00100000:3.0:1788837574.411271:0:7479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f39530b9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875732036855168:0@lo:1000: 00000100:00100000:3.0:1788837574.411304:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837574.411340:0:7479:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c28937eb going to sleep for 11 seconds 00000040:00080000:0.0:1788837574.412013:0:7454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788837574.412562:0:7454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788837574.412593:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:2.0:1788837574.412826:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036855168 00000100:00100000:2.0:1788837574.412832:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036855168 00000100:00100000:2.0:1788837574.412870:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788837574.412878:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7a34813 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875732036855168:12345-0@lo:1000: 00000100:00100000:2.0:1788837574.412993:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7a34813 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875732036855168:12345-0@lo:1000: Request processed in 115us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837574.413000:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837574.413196:0:7479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f39530b9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875732036855168:0@lo:1000: 00000004:00080000:3.0:1788837574.413263:0:7479:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c16c2d7b with version 0 00000020:00100000:3.0:1788837574.413284:0:7479:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788837574.413290:0:7479:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f39530b9 x1875732036855424/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837574.413312:0:7479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f39530b9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875732036855424:0@lo:1000: 00000100:00100000:3.0:1788837574.413358:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837574.413386:0:7479:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c28937eb going to sleep for 11 seconds 00000040:00080000:0.0:1788837574.414289:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788837574.414519:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036855424 00000100:00100000:2.0:1788837574.414526:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036855424 00000100:00100000:2.0:1788837574.414570:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837574.414578:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd296bee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875732036855424:12345-0@lo:1000: 00080000:10000000:0.0:1788837574.416191:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 40000000:02000000:3.0:1788837574.416367:0:6531:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:0.0:1788837574.418390:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788837574.419911:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788837574.420152:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788837574.420504:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788837574.420672:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788837574.421948:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788837574.422096:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788837574.423464:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000001:00080000:1.0:1788837574.425117:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:0.0:1788837574.427873:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000100:00100000:2.0:1788837574.427966:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd296bee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7479:x1875732036855424:12345-0@lo:1000: Request processed in 13385us (14603us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788837574.427978:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1788837574.428038:0:7479:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788837574.428042:0:7479:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788837574.428059:0:7479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f39530b9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875732036855424:0@lo:1000: 00000100:00100000:2.0:1788837574.428153:0:7479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0cacc6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875732036855552:0@lo:1000: 00100000:10000000:0.0:1788837574.428182:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00000100:00100000:2.0:1788837574.428191:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837574.428223:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036855552 00000100:00100000:2.0:1788837574.428229:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036855552 00000100:00100000:2.0:1788837574.428264:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837574.428271:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000307b9bc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1875732036855552:12345-0@lo:1000: 00100000:10000000:0.0:1788837574.428318:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000100:00100000:2.0:1788837574.428339:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000307b9bc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7479:x1875732036855552:12345-0@lo:1000: Request processed in 68us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837574.428346:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837574.428382:0:7479:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061a16abf going to sleep for 11 seconds 00000100:00100000:2.0:1788837574.428394:0:7479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0cacc6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7479:1875732036855552:0@lo:1000: 00000040:00080000:2.0:1788837574.428409:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788837574.428435:0:7479:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000055eb07d4 with version 1 00100000:10000000:0.0:1788837574.428709:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788837574.428870:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788837574.428979:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788837574.429084:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788837574.429192:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000004:00080000:1.0:1788837574.429404:0:7469:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000005a0df6f9 version 1 rpc_version 1 00000020:00100000:1.0:1788837574.429424:0:7469:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788837574.429431:0:7469:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000008f0526a4 x1875732036855808/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837574.429447:0:7469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f0526a4 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7469:1875732036855808:0@lo:1000: 00000100:00100000:1.0:1788837574.429483:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837574.429510:0:7469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c042b34a going to sleep for 11 seconds 00000100:00100000:1.0:1788837574.430030:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036855808 00000100:00100000:1.0:1788837574.430037:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036855808 00000100:00100000:1.0:1788837574.430071:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837574.430077:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da650aae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1875732036855808:12345-0@lo:1000: 00000040:00080000:2.0:1788837574.430484:0:7479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788837574.430539:0:7479:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:0.0:1788837574.430987:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788837574.431160:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788837574.431464:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788837574.431691:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788837574.432047:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788837574.432173:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788837574.435573:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000100:00100000:3.0:1788837574.436815:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae0e905c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7478:x1875732036854656:12345-0@lo:700: Request processed in 28436us (29463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837574.436836:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788837574.436878:0:7478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000bb63bde9 x1875732036854656/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788837590 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837574.436894:0:7478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb63bde9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7478:1875732036854656:0@lo:700: 40000000:02000000:1.0:1788837574.436909:0:7478:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:0.0:1788837574.443282:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788837574.443503:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788837574.443998:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788837574.444199:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788837574.444371:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788837574.444505:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788837574.445160:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788837574.445298:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788837574.445447:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788837574.445677:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788837574.455963:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788837574.456175:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da650aae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1875732036855808:12345-0@lo:1000: Request processed in 26093us (26688us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788837574.456189:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1788837574.456198:0:7469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788837574.456203:0:7469:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788837574.456220:0:7469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f0526a4 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7469:1875732036855808:0@lo:1000: 00000001:00080000:0.0:1788837574.457352:0:7454:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788837574.457386:0:7454:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa3bc81daf988 00100000:10000000:0.0:1788837574.457394:0:7454:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788837574.459452:0:7454:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788837574.459486:0:7454:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788837574.459502:0:7454:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788837574.459519:0:7454:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788837574.463437:0:7454:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788837574.465098:0:7454:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1788837574.488170:0:7478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837574.524318:0:7478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788837574.524413:0:7478:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788837574.524418:0:7478:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1788837575.353402:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837576.377133:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837577.401193:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837578.425905:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837579.448951:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788837579.624345:0:7724:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788837579.706790:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a50211d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036856320:0@lo:400: 00000100:00100000:2.0:1788837579.706866:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837579.706878:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0cacc6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036855936:0@lo:400: 00000100:00100000:1.0:1788837579.706914:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837579.706932:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a141737 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036856064:0@lo:400: 00000100:00100000:2.0:1788837579.706956:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837579.706987:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837579.706992:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a0e3f79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036856192:0@lo:400: 00000100:00100000:2.0:1788837579.707018:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837579.707051:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036856320 00000100:00100000:2.0:1788837579.707057:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036856320 00000100:00100000:2.0:1788837579.707096:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036856064 00000100:00100000:2.0:1788837579.707100:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036856064 00000100:00100000:2.0:1788837579.707117:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837579.707124:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017042218 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036856320:12345-0@lo:400: 00000100:00100000:2.0:1788837579.707178:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017042218 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036856320:12345-0@lo:400: Request processed in 55us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837579.707186:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837579.707216:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837579.707223:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fecce8cd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036856064:12345-0@lo:400: 00000100:00100000:2.0:1788837579.707266:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fecce8cd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036856064:12345-0@lo:400: Request processed in 44us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837579.707289:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837579.707307:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036856192 00000100:00100000:2.0:1788837579.707311:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036856192 00000100:00100000:2.0:1788837579.707331:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788837579.707335:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083c3e1bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036856192:12345-0@lo:400: 00000100:00100000:2.0:1788837579.707370:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083c3e1bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036856192:12345-0@lo:400: Request processed in 34us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837579.707376:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788837579.707414:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a0e3f79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036856192:0@lo:400: 00010000:00080000:2.0:1788837579.707428:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009a141737 x1875732036856064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837579.707438:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a141737 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036856064:0@lo:400: 00010000:00080000:2.0:1788837579.707467:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003a50211d x1875732036856320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837579.707476:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a50211d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036856320:0@lo:400: 00000100:00100000:2.0:1788837579.707527:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a50211d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036856448:0@lo:41: 00000100:00100000:2.0:1788837579.707549:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837579.707568:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036856448 00000100:00100000:2.0:1788837579.707571:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036856448 00000100:00100000:2.0:1788837579.707586:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788837579.707590:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a141737 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036856448:12345-0@lo:41: 00000004:00000024:2.0:1788837579.707613:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788837579.707644:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a141737 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036856448:12345-0@lo:41: Request processed in 54us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837579.707651:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788837579.707684:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a50211d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036856448:0@lo:41: 00000100:00100000:1.0:1788837579.708006:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036855936 00000100:00100000:1.0:1788837579.708012:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036855936 00000100:00100000:1.0:1788837579.709137:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788837579.709152:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9745fad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:3649:x1875732036855936:12345-0@lo:400: 00000100:00100000:1.0:1788837579.709227:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9745fad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:3649:x1875732036855936:12345-0@lo:400: Request processed in 82us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837579.709262:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788837579.713338:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0cacc6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036855936:0@lo:400: 00010000:00010000:0.0:1788837580.477585:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788837580.528217:0:7776:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788837580.528446:0:7776:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788837581.502807:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837582.530171:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837583.546574:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788837583.574681:0:7877:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788837583.575216:0:7877:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788837583.801104:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788837583.801112:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ae7d4b000 from 4 10000000:01000000:1.0:1788837583.801135:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788837583.801189:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 0000000069b26122/0x57f6d4e926aeec85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.801202:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 0000000069b26122/0x57f6d4e926aeec85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.801212:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 0000000069b26122/0x57f6d4e926aeec85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837583.801235:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000079c9e817 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036856576:0@lo:101: 00000100:00100000:1.0:1788837583.801302:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837583.801442:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036856576 00000100:00100000:2.0:1788837583.801451:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036856576 00000100:00100000:2.0:1788837583.801515:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788837583.801524:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000732838ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:6521:x1875732036856576:12345-0@lo:101: 00010000:00010000:2.0:1788837583.801537:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837583.801550:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e92db882/0x57f6d4e926aeec8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeec85 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837583.801572:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e92db882/0x57f6d4e926aeec8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeec85 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837583.801581:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e92db882/0x57f6d4e926aeec8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeec85 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837583.801588:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e92db882, rc 0) 00000100:00100000:2.0:1788837583.801624:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000732838ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:6521:x1875732036856576:12345-0@lo:101: Request processed in 102us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837583.801631:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788837583.802083:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efba8172 going to sleep for 11 seconds 00000100:00100000:1.0:1788837583.802106:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000079c9e817 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036856576:0@lo:101: 00010000:00010000:1.0:1788837583.802119:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 0000000069b26122/0x57f6d4e926aeec85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec8c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.802127:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 0000000069b26122/0x57f6d4e926aeec85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeec8c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837583.802181:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000079c9e817 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036856704:0@lo:256: 00000100:00100000:1.0:1788837583.802214:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837583.802302:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036856704 00000100:00100000:3.0:1788837583.802308:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036856704 00000100:00100000:3.0:1788837583.802341:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788837583.802348:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000700145b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:6521:x1875732036856704:12345-0@lo:256: 20000000:01000000:3.0:1788837583.802362:0:6518:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788837583.802385:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788837583.802388:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788837583.802452:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000700145b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:6521:x1875732036856704:12345-0@lo:256: Request processed in 105us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837583.802459:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788837583.804500:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efba8172 going to sleep for 11 seconds 00000100:00100000:1.0:1788837583.804542:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000079c9e817 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036856704:0@lo:256: 10000000:01000000:1.0:1788837583.804602:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788837583.804609:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 0000000069b26122/0x57f6d4e926aeec85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec8c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.804617:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 0000000069b26122/0x57f6d4e926aeec85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec8c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837583.804636:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788837583.804638:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ac3ec4000 from 21 10000000:01000000:1.0:1788837583.804641:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788837583.804666:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeec93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.804673:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeec93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.804680:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeec93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837583.804694:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000079c9e817 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036856832:0@lo:101: 00000100:00100000:1.0:1788837583.804751:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837583.804870:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efba8172 going to sleep for 11 seconds 00000100:00100000:3.0:1788837583.808582:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036856832 00000100:00100000:3.0:1788837583.808598:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036856832 00000100:00100000:3.0:1788837583.808729:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788837583.808740:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b7aca70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:6521:x1875732036856832:12345-0@lo:101: 00010000:00010000:3.0:1788837583.808759:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837583.810194:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d696b65d/0x57f6d4e926aeec9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeec93 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837583.810258:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d696b65d/0x57f6d4e926aeec9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeec93 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837583.810291:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d696b65d/0x57f6d4e926aeec9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeec93 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837583.810300:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d696b65d, rc 0) 00000100:00100000:3.0:1788837583.811590:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b7aca70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036856832:12345-0@lo:101: Request processed in 2848us (6834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837583.811601:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788837583.815633:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000079c9e817 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036856832:0@lo:101: 00010000:00010000:0.0:1788837583.815668:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeec93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec9a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837583.815682:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeec93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeec9a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837583.815812:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036856960:0@lo:501: 00000100:00100000:0.0:1788837583.815874:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837583.815999:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d31049b5 going to sleep for 11 seconds 00000100:00100000:3.0:1788837583.818521:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036856960 00000100:00100000:3.0:1788837583.818538:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036856960 00000100:00100000:3.0:1788837583.818605:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788837583.818614:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8bea215 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036856960:12345-0@lo:501: 00000100:00100000:3.0:1788837583.818802:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8bea215 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036856960:12345-0@lo:501: Request processed in 188us (2928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837583.818810:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788837583.819536:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036856960:0@lo:501: 00000100:00100000:0.0:1788837583.819601:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036857088:0@lo:503: 00000100:00100000:0.0:1788837583.819661:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837583.819700:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d31049b5 going to sleep for 11 seconds 00000100:00100000:2.0:1788837583.820515:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036857088 00000100:00100000:2.0:1788837583.820523:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036857088 00000100:00100000:2.0:1788837583.820565:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788837583.820572:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a1a1c09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036857088:12345-0@lo:503: 00000100:00100000:2.0:1788837583.820687:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a1a1c09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036857088:12345-0@lo:503: Request processed in 115us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837583.820701:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788837583.822731:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036857088:0@lo:503: 00000100:00100000:3.0:1788837583.823905:0:7889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e7eab22 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7889:1875732036857216:0@lo:502: 00000100:00100000:3.0:1788837583.823996:0:7889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837583.824040:0:7889:0:(client.c:2715:ptlrpc_set_wait()) set 0000000049dadd4f going to sleep for 11 seconds 00000100:00100000:2.0:1788837583.824300:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036857216 00000100:00100000:2.0:1788837583.824308:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036857216 00000100:00100000:2.0:1788837583.824353:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788837583.824361:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb38a7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:7889:x1875732036857216:12345-0@lo:502: 00000100:00100000:2.0:1788837583.824566:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb38a7f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:7889:x1875732036857216:12345-0@lo:502: Request processed in 205us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837583.824574:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788837583.824712:0:7889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e7eab22 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7889:1875732036857216:0@lo:502: 00000100:00100000:0.0:1788837583.824761:0:7889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7889:1875732036857344:0@lo:502: 00000100:00100000:0.0:1788837583.824833:0:7889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837583.824850:0:7889:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d31049b5 going to sleep for 11 seconds 00000100:00100000:2.0:1788837583.825476:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036857344 00000100:00100000:2.0:1788837583.825484:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036857344 00000100:00100000:2.0:1788837583.825526:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788837583.825532:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ddc3ae2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:7889:x1875732036857344:12345-0@lo:502: 00000100:00100000:2.0:1788837583.825632:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ddc3ae2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:7889:x1875732036857344:12345-0@lo:502: Request processed in 101us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837583.825639:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788837583.825895:0:7889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7889:1875732036857344:0@lo:502: 00000040:00080000:0.0:1788837583.825923:0:7889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788837583.826094:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788837583.826116:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788837583.826124:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeec93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec9a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.826132:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 0000000037ab2f23/0x57f6d4e926aeec93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeec9a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837583.826141:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788837583.826144:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ac3ec4000 from 4 10000000:01000000:1.0:1788837583.826146:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788837583.826187:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 000000000a58f2dc/0x57f6d4e926aeeca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.826207:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 000000000a58f2dc/0x57f6d4e926aeeca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.826215:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 000000000a58f2dc/0x57f6d4e926aeeca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837583.826229:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007dd00411 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036857472:0@lo:101: 00000100:00100000:1.0:1788837583.826264:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837583.826624:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c042b34a going to sleep for 11 seconds 00000100:00100000:0.0:1788837583.827500:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036857472 00000100:00100000:0.0:1788837583.827509:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036857472 00000100:00100000:0.0:1788837583.827560:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788837583.827567:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020f6dd03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036857472:12345-0@lo:101: 00010000:00010000:0.0:1788837583.827580:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837583.827595:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000022e39343/0x57f6d4e926aeeca8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeca1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837583.827627:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022e39343/0x57f6d4e926aeeca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeca1 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837583.827647:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000022e39343/0x57f6d4e926aeeca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeca1 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837583.827655:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000022e39343, rc 0) 00000100:00100000:0.0:1788837583.827711:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020f6dd03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036857472:12345-0@lo:101: Request processed in 144us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837583.827717:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788837583.828202:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007dd00411 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036857472:0@lo:101: 00010000:00010000:1.0:1788837583.828221:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 000000000a58f2dc/0x57f6d4e926aeeca1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeca8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.828229:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 000000000a58f2dc/0x57f6d4e926aeeca1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeca8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837583.828284:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007dd00411 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036857600:0@lo:256: 00000100:00100000:1.0:1788837583.828320:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837583.828355:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c042b34a going to sleep for 11 seconds 00000100:00100000:0.0:1788837583.828463:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036857600 00000100:00100000:0.0:1788837583.828467:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036857600 00000100:00100000:0.0:1788837583.828498:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788837583.828504:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e15b331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036857600:12345-0@lo:256: 20000000:01000000:0.0:1788837583.828516:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788837583.828530:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788837583.828532:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788837583.828718:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e15b331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036857600:12345-0@lo:256: Request processed in 214us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837583.828725:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788837583.832943:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007dd00411 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036857600:0@lo:256: 10000000:01000000:1.0:1788837583.833017:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788837583.833027:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 000000000a58f2dc/0x57f6d4e926aeeca1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeca8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.833038:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 000000000a58f2dc/0x57f6d4e926aeeca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeca8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837583.833062:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788837583.833065:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788837583.833067:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788837583.833097:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000383dde74/0x57f6d4e926aeecaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.833103:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000383dde74/0x57f6d4e926aeecaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.833111:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000383dde74/0x57f6d4e926aeecaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837583.833127:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007dd00411 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036857728:0@lo:101: 00000100:00100000:1.0:1788837583.833196:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837583.833287:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c042b34a going to sleep for 11 seconds 00000100:00100000:3.0:1788837583.836554:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036857728 00000100:00100000:3.0:1788837583.836569:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036857728 00000100:00100000:0.0:1788837583.837859:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788837583.837871:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000286623a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036857728:12345-0@lo:101: 00010000:00010000:0.0:1788837583.837889:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837583.837907:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d89ac32e/0x57f6d4e926aeecb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeecaf expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837583.837937:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d89ac32e/0x57f6d4e926aeecb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeecaf expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837583.837947:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d89ac32e/0x57f6d4e926aeecb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeecaf expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837583.837971:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d89ac32e, rc 0) 00000100:00100000:0.0:1788837583.838048:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000286623a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036857728:12345-0@lo:101: Request processed in 180us (4852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837583.838056:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788837583.838237:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007dd00411 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036857728:0@lo:101: 00010000:00010000:1.0:1788837583.838255:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000383dde74/0x57f6d4e926aeecaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeecb6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.838264:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000383dde74/0x57f6d4e926aeecaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeecb6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837583.838341:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007dd00411 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036857856:0@lo:501: 00000100:00100000:1.0:1788837583.838388:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837583.838540:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c042b34a going to sleep for 11 seconds 00000100:00100000:2.0:1788837583.838724:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036857856 00000100:00100000:2.0:1788837583.838730:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036857856 00000100:00100000:2.0:1788837583.838757:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788837583.838763:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d3dbf44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036857856:12345-0@lo:501: 00000100:00100000:2.0:1788837583.841694:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d3dbf44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036857856:12345-0@lo:501: Request processed in 2923us (3299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837583.841709:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788837583.843836:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007dd00411 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036857856:0@lo:501: 00000100:00100000:1.0:1788837583.843896:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007dd00411 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036857984:0@lo:503: 00000100:00100000:1.0:1788837583.843986:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837583.844081:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c042b34a going to sleep for 11 seconds 00000100:00100000:3.0:1788837583.844151:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036857984 00000100:00100000:3.0:1788837583.844158:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036857984 00000100:00100000:2.0:1788837583.844329:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788837583.844339:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d52300fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036857984:12345-0@lo:503: 00000100:00100000:2.0:1788837583.844911:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d52300fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036857984:12345-0@lo:503: Request processed in 572us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837583.844928:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788837583.845150:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007dd00411 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036857984:0@lo:503: 00000100:00100000:1.0:1788837583.847586:0:7890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007dd00411 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7890:1875732036858112:0@lo:502: 00000100:00100000:1.0:1788837583.847673:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837583.847722:0:7890:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d5dd74c3 going to sleep for 11 seconds 00000100:00100000:0.0:1788837583.847813:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036858112 00000100:00100000:0.0:1788837583.847821:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036858112 00000100:00100000:0.0:1788837583.847864:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788837583.847870:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c257760 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:7890:x1875732036858112:12345-0@lo:502: 00000100:00100000:0.0:1788837583.847985:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c257760 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:7890:x1875732036858112:12345-0@lo:502: Request processed in 114us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837583.847993:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788837583.848487:0:7890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007dd00411 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7890:1875732036858112:0@lo:502: 00000020:01000000:1.0:1788837583.848519:0:7890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837583.848531:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837583.848533:0:7890:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788837583.848538:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788837583.848541:0:7890:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:00000080:1.0:1788837583.848565:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788837583.848591:0:7890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000091643dfa) 00000020:00000080:1.0:1788837583.848614:0:7890:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788837583.848621:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788837583.848699:0:7890:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788837583.848705:0:7890:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788837583.848711:0:7890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926aeecc4 00010000:00080000:1.0:1788837583.848739:0:7890:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000074f973c@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:1.0:1788837583.852815:0:7890:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1788837583.854292:0:7890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837583.854307:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788837583.854343:0:7890:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788837583.854427:0:7890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926aeeccb 00000100:00080000:3.0:1788837583.854440:0:7890:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788837583.854445:0:7890:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000074f973c using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837583.854490:0:7890:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000251f383b x1875732036858240/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837583.854555:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000251f383b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732036858240:0@lo:38: 00000100:00100000:1.0:1788837583.854627:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837583.854714:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036858240 00000100:00100000:2.0:1788837583.854723:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036858240 00000100:00100000:2.0:1788837583.854766:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788837583.854771:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007dd00411 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875732036858240:12345-0@lo:38: 00010000:00080000:2.0:1788837583.854820:0:6529:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1788837583.854853:0:6529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926aeecd2 00000004:00100000:2.0:1788837583.854867:0:6529:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788837583.854873:0:6529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788837583.855104:0:7890:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1788837583.855146:0:7890:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788837583.855592:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a50211d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036858496:0@lo:400: 00000100:00100000:2.0:1788837583.855634:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837583.855661:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837583.855667:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0cacc6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036858368:0@lo:400: 00000100:00100000:2.0:1788837583.855690:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837583.855715:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a0e3f79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036858624:0@lo:400: 00000100:00100000:2.0:1788837583.855750:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837583.855808:0:6530:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788837583.855818:0:6530:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788837583.855832:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036858368 00000100:00100000:2.0:1788837583.855837:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036858368 00000100:00100000:2.0:1788837583.855870:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036858624 00000100:00100000:2.0:1788837583.855873:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036858624 00000100:00100000:2.0:1788837583.855888:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837583.855894:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd07f9d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036858368:12345-0@lo:400: 00000100:00100000:2.0:1788837583.855946:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd07f9d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036858368:12345-0@lo:400: Request processed in 52us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837583.855953:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837583.855978:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788837583.855983:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb82782c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036858624:12345-0@lo:400: 00000100:00100000:2.0:1788837583.856017:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb82782c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036858624:12345-0@lo:400: Request processed in 33us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837583.856023:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788837583.856062:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005a0e3f79 x1875732036858624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837583.856075:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a0e3f79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036858624:0@lo:400: 00010000:00080000:2.0:1788837583.856103:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b0cacc6e x1875732036858368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837583.856112:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0cacc6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036858368:0@lo:400: 00000020:01000000:3.0:1788837583.856500:0:7890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837583.856506:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837583.856508:0:7890:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788837583.856511:0:7890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837583.856514:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837583.856516:0:7890:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788837583.856518:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788837583.856519:0:7890:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788837583.856543:0:7890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9859662 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7890:1875732036858752:0@lo:502: 00000100:00100000:3.0:1788837583.856587:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837583.856612:0:7890:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e8998f46 going to sleep for 11 seconds 00000100:00080000:0.0:1788837583.856668:0:7893:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000007248402f x1875732036858880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837583.856676:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005fcb566 going to sleep for 0 seconds 00000100:00100000:2.0:1788837583.857524:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036858752 00000100:00100000:2.0:1788837583.857532:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036858752 00000100:00100000:2.0:1788837583.857575:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788837583.857582:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc1672ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:7890:x1875732036858752:12345-0@lo:502: 00000100:00100000:2.0:1788837583.857920:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc1672ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:7890:x1875732036858752:12345-0@lo:502: Request processed in 338us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837583.857928:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788837583.859717:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036858496 00000100:00100000:2.0:1788837583.859728:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036858496 00000100:00100000:1.0:1788837583.860586:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788837583.860598:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a91118e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036858496:12345-0@lo:400: 00000100:00100000:1.0:1788837583.860709:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a91118e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036858496:12345-0@lo:400: Request processed in 114us (5075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837583.860726:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788837583.860829:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a50211d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036858496:0@lo:400: 00000100:00100000:3.0:1788837583.861835:0:7890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9859662 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:7890:1875732036858752:0@lo:502: 00000020:01000000:2.0:1788837583.873279:0:7890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837583.873298:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837583.873301:0:7890:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788837583.873307:0:7890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00080000:0.0:1788837583.881673:0:6529:0:(import.c:65:import_set_state_nolock()) 000000004ec89172 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837583.881819:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007dd00411 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875732036858240:12345-0@lo:38: Request processed in 27045us (27191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837583.881834:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837583.881965:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837583.881974:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788837583.881982:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788837583.881987:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788837583.881989:0:3647:0:(import.c:65:import_set_state_nolock()) 00000000074f973c lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788837583.882007:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000005fcb566): req@000000007248402f x1875732036858880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837583.882023:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000251f383b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732036858240:0@lo:38: 00000100:00100000:2.0:1788837583.882118:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837583.882140:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb3a1d70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036859008:0@lo:41: 00000100:00100000:2.0:1788837583.882196:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837583.882254:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036859008 00000100:00100000:2.0:1788837583.882260:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036859008 00000100:00100000:2.0:1788837583.882296:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837583.882303:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7affedc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036859008:12345-0@lo:41: 00000004:00000024:2.0:1788837583.882328:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788837583.882362:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7affedc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036859008:12345-0@lo:41: Request processed in 60us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837583.882368:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837583.882397:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb3a1d70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036859008:0@lo:41: 00000100:00100000:0.0:1788837583.882573:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837583.882596:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005fcb566 going to sleep for 11 seconds 00000100:00100000:2.0:1788837583.882642:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036858880 00000100:00100000:2.0:1788837583.882646:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036858880 00000100:00100000:2.0:1788837583.882677:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837583.882682:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000250e2fb9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7893:x1875732036858880:12345-0@lo:1000: 00000100:00100000:2.0:1788837583.882751:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000250e2fb9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7893:x1875732036858880:12345-0@lo:1000: Request processed in 69us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837583.882758:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788837583.882868:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875732036858880:0@lo:1000: 00000040:01000000:0.0:1788837583.882896:0:7893:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788837583.882928:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875732036859136:0@lo:1000: 00000100:00100000:0.0:1788837583.882957:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837583.882979:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005fcb566 going to sleep for 11 seconds 00000020:01000000:1.0:1788837583.883056:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788837583.883082:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788837583.883090:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000383dde74/0x57f6d4e926aeecaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeecb6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837583.883099:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 00000000383dde74/0x57f6d4e926aeecaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeecb6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837583.883135:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036859136 00000100:00100000:1.0:1788837583.883139:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036859136 00000100:00100000:1.0:1788837583.883180:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788837583.883186:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb63bde9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7893:x1875732036859136:12345-0@lo:1000: 00000100:00100000:1.0:1788837583.883285:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb63bde9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7893:x1875732036859136:12345-0@lo:1000: Request processed in 99us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837583.883292:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 10000000:01000000:0.0:1788837583.883464:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788837583.883476:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff889ac85799b8 from 1 10000000:01000000:0.0:1788837583.883479:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788837583.883502:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeecd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837583.883509:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeecd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837583.883516:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeecd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837583.883525:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b945a657 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036859264:0@lo:101: 00000100:00100000:0.0:1788837583.883552:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837583.883580:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 000000006eb90b59 going to sleep for 11 seconds 00000100:00100000:0.0:1788837583.883599:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875732036859136:0@lo:1000: 00000100:00100000:0.0:1788837583.883633:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875732036859392:0@lo:700: 00000100:00100000:0.0:1788837583.883656:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837583.883678:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b23aec2f going to sleep for 11 seconds 00000100:00100000:2.0:1788837583.885583:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036859264 00000100:00100000:2.0:1788837583.885597:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036859264 00000100:00100000:2.0:1788837583.885660:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788837583.885669:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b3086fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036859264:12345-0@lo:101: 00010000:00010000:2.0:1788837583.885684:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837583.885700:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dc5818b2/0x57f6d4e926aeece0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeecd9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837583.885726:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc5818b2/0x57f6d4e926aeece0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeecd9 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837583.885757:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dc5818b2/0x57f6d4e926aeece0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeecd9 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837583.885764:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dc5818b2, rc 0) 00000100:00100000:2.0:1788837583.885851:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b3086fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036859264:12345-0@lo:101: Request processed in 183us (2298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837583.885859:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788837583.885971:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036859392 00000100:00100000:1.0:1788837583.885977:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036859392 00000100:00100000:1.0:1788837583.886014:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837583.886020:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002039f0b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7893:x1875732036859392:12345-0@lo:700: 00000100:00100000:1.0:1788837583.886068:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002039f0b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7893:x1875732036859392:12345-0@lo:700: Request processed in 49us (2412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837583.886074:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837583.886271:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b945a657 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036859264:0@lo:101: 00010000:00010000:0.0:1788837583.886289:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeecd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeece0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837583.886298:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeecd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeece0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837583.886386:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b945a657 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036859520:0@lo:501: 00000100:00100000:0.0:1788837583.886417:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837583.886454:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 000000006eb90b59 going to sleep for 11 seconds 00000100:00100000:0.0:1788837583.886486:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875732036859392:0@lo:700: 00000100:00100000:0.0:1788837583.886638:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875732036859648:0@lo:1000: 00000100:00100000:0.0:1788837583.886667:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837583.886734:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036859520 00000100:00100000:2.0:1788837583.886738:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036859520 00000100:00100000:2.0:1788837583.886769:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788837583.886826:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0467c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036859520:12345-0@lo:501: 00000100:00100000:2.0:1788837583.886899:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0467c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036859520:12345-0@lo:501: Request processed in 124us (481us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788837583.886906:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788837583.887514:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b573719c going to sleep for 11 seconds 00000100:00100000:0.0:1788837583.887539:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b945a657 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036859520:0@lo:501: 10000000:01000000:0.0:1788837583.887567:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788837583.887573:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeecd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeece0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837583.887581:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 00000000134faf7a/0x57f6d4e926aeecd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeece0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837583.894882:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036859648 00000100:00100000:1.0:1788837583.894900:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036859648 00000100:00100000:1.0:1788837583.895092:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788837583.895102:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eac9752d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7893:x1875732036859648:12345-0@lo:1000: 00000100:00100000:1.0:1788837583.895296:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eac9752d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7893:x1875732036859648:12345-0@lo:1000: Request processed in 196us (8628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837583.895305:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837583.902800:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875732036859648:0@lo:1000: 00000004:00080000:0.0:1788837583.902888:0:7893:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b23aec2f with version 0 00000020:00100000:0.0:1788837583.902914:0:7893:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788837583.902921:0:7893:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000007248402f x1875732036859904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837583.902941:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875732036859904:0@lo:1000: 00000100:00100000:0.0:1788837583.903005:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837583.903052:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dbf63d09 going to sleep for 11 seconds 00000100:00100000:3.0:1788837583.903257:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036859904 00000100:00100000:3.0:1788837583.903265:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036859904 00000100:00100000:3.0:1788837583.903325:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788837583.903333:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b945a657 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7893:x1875732036859904:12345-0@lo:1000: 00000001:00080000:3.0:1788837583.905136:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1788837583.905150:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788837583.905289:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b945a657 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7893:x1875732036859904:12345-0@lo:1000: Request processed in 1954us (2281us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788837583.905300:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788837583.905376:0:7893:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788837583.905381:0:7893:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788837583.905395:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875732036859904:0@lo:1000: 00000100:00100000:0.0:1788837583.905475:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875732036860032:0@lo:1000: 00000100:00100000:0.0:1788837583.905514:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837583.905554:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005fcb566 going to sleep for 11 seconds 00000100:00100000:3.0:1788837583.905615:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036860032 00000100:00100000:3.0:1788837583.905622:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036860032 00000100:00100000:3.0:1788837583.905666:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788837583.905674:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a9a1601 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7893:x1875732036860032:12345-0@lo:1000: 00000100:00100000:3.0:1788837583.905769:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a9a1601 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7893:x1875732036860032:12345-0@lo:1000: Request processed in 95us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837583.905802:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837583.905927:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007248402f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875732036860032:0@lo:1000: 00000040:00080000:2.0:1788837583.905946:0:7893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788837583.905978:0:7893:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000005bdf981a with version 1 00000004:00080000:3.0:1788837583.907129:0:7891:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000b827f526 version 1 rpc_version 1 00000020:00100000:3.0:1788837583.907173:0:7891:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788837583.907182:0:7891:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000251f383b x1875732036860288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837583.907203:0:7891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000251f383b pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7891:1875732036860288:0@lo:1000: 00000100:00100000:3.0:1788837583.907255:0:7891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837583.907295:0:7891:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095936ce9 going to sleep for 11 seconds 00000100:00100000:0.0:1788837583.907362:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036860288 00000100:00100000:0.0:1788837583.907369:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036860288 00000100:00100000:0.0:1788837583.907418:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837583.907426:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9859662 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7891:x1875732036860288:12345-0@lo:1000: 00000001:00080000:0.0:1788837583.911609:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000040:00080000:2.0:1788837583.911705:0:7893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788837583.911809:0:7893:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788837583.911815:0:7893:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1788837583.913286:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9859662 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7891:x1875732036860288:12345-0@lo:1000: Request processed in 5852us (6023us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788837583.913302:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:2.0:1788837583.913544:0:7891:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788837583.913550:0:7891:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788837583.913568:0:7891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000251f383b pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7891:1875732036860288:0@lo:1000: 00010000:00010000:1.0:1788837584.570118:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788837584.714659:0:7931:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd731e7a80 20000000:00000080:0.0:1788837584.714739:0:7931:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff889afa566400 uarg=0000000000000000 20000000:01000000:0.0:1788837584.715077:0:7931:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788837584.715086:0:7931:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788837584.715091:0:7931:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788837584.715178:0:7931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788837584.715189:0:7931:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788837584.720950:0:7931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837584.721291:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788837584.721321:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788837584.721335:0:7931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788837584.721350:0:7931:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788837584.721377:0:7931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837584.721398:0:7931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000503a0260/0x57f6d4e926aeeb66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeb5f expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837584.721406:0:7931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c8ef0ae3/0x57f6d4e926aeec54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeec4d expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837584.721642:0:7931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837584.721755:0:7931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c8ef0ae3/0x57f6d4e926aeec54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeec4d expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837584.721990:0:7931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c8ef0ae3/0x57f6d4e926aeec54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeec4d expref: 17 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837584.722015:0:7931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c100226a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1875732036860416:0@lo:104: 00000100:00100000:0.0:1788837584.722086:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837584.722164:0:7931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000503a0260/0x57f6d4e926aeeb66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeeb5f expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837584.722171:0:7931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000503a0260/0x57f6d4e926aeeb66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb5f expref: 17 pid: 6518 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837584.722178:0:7931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005655a8ae pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1875732036860544:0@lo:104: 00000100:00100000:0.0:1788837584.722197:0:7931:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005fcb566 going to sleep for 11 seconds 00000100:00100000:2.0:1788837584.722274:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788837584.722293:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837584.722318:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036860416 00000100:00100000:2.0:1788837584.722325:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036860416 00000100:00100000:2.0:1788837584.722370:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036860544 00000100:00100000:2.0:1788837584.722373:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036860544 00000100:00100000:2.0:1788837584.722388:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837584.722395:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000114fa3f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:7931:x1875732036860416:12345-0@lo:104: 00010000:00010000:2.0:1788837584.722406:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeec54 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.722477:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788837584.722483:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000114fa3f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:7931:x1875732036860416:12345-0@lo:104: Request processed in 89us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837584.722490:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837584.722530:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788837584.722536:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb3a1d70 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:7931:x1875732036860544:12345-0@lo:104: 00010000:00010000:2.0:1788837584.722543:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeb66 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.722577:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788837584.722593:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb3a1d70 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:7931:x1875732036860544:12345-0@lo:104: Request processed in 58us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837584.722599:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788837584.722615:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837584.722620:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeec54 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.722627:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000737a25ac already unused, calling callback (0000000091ee5375) 10000000:00010000:2.0:1788837584.722639:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeec54 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.722646:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeec54 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837584.722652:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeec54 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837584.722657:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788837584.722867:0:7931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c100226a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1875732036860416:0@lo:104: 00000100:00100000:0.0:1788837584.722877:0:7931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005655a8ae pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7931:1875732036860544:0@lo:104: 00010000:00010000:0.0:1788837584.722894:0:7931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723017:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec54 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723025:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837584.723051:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec54 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723058:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 00000000737a25ac/0x57f6d4e926aeec4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec54 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723071:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837584.723074:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeb66 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723078:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000055ef6a38 already unused, calling callback (0000000091ee5375) 10000000:00010000:2.0:1788837584.723080:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeeb66 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723086:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeeb66 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837584.723101:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeeb66 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837584.723106:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788837584.723119:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb66 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723124:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837584.723130:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb66 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723135:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 0000000055ef6a38/0x57f6d4e926aeeb5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeb66 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723158:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837584.723160:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837584.723161:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837584.723168:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837584.723185:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000609b8696 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036860800:0@lo:103: 00000100:00100000:2.0:1788837584.723218:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837584.723241:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837584.723247:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2c97163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036860672:0@lo:103: 00000100:00100000:2.0:1788837584.723266:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837584.723290:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036860800 00000100:00100000:2.0:1788837584.723294:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036860800 00010000:00010000:2.0:1788837584.723311:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000503a0260/0x57f6d4e926aeeb66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb5f expref: 18 pid: 6518 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837584.723329:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036860672 00000100:00100000:2.0:1788837584.723339:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036860672 00010000:00010000:2.0:1788837584.723352:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c8ef0ae3/0x57f6d4e926aeec54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeec4d expref: 19 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837584.723366:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837584.723371:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029ade2e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:3651:x1875732036860800:12345-0@lo:103: 00010000:00010000:2.0:1788837584.723381:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837584.723385:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000503a0260/0x57f6d4e926aeeb66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb5f expref: 19 pid: 6518 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723394:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000503a0260/0x57f6d4e926aeeb66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeeb5f expref: 19 pid: 6518 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723405:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000503a0260/0x57f6d4e926aeeb66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeeb5f expref: 19 pid: 6518 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723428:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837584.723458:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029ade2e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:3651:x1875732036860800:12345-0@lo:103: Request processed in 87us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837584.723465:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837584.723478:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788837584.723483:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032b84d08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:3651:x1875732036860672:12345-0@lo:103: 00010000:00010000:2.0:1788837584.723489:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837584.723493:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c8ef0ae3/0x57f6d4e926aeec54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeec4d expref: 17 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723500:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c8ef0ae3/0x57f6d4e926aeec54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeec4d expref: 17 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723509:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c8ef0ae3/0x57f6d4e926aeec54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeec4d expref: 17 pid: 6516 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723524:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723532:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723544:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723550:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723557:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723563:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723567:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006c19f838 already unused, calling callback (00000000e9b23507) 00010000:00010000:2.0:1788837584.723571:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723591:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723601:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837584.723609:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837584.723632:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032b84d08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:3651:x1875732036860672:12345-0@lo:103: Request processed in 150us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837584.723647:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788837584.724049:0:7931:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837584.724058:0:7931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837584.724064:0:7931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006c19f838/0x57f6d4e926aeece7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837584.725560:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2c97163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036860672:0@lo:103: 00000100:00100000:2.0:1788837584.726565:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000609b8696 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036860800:0@lo:103: 00000100:00100000:1.0:1788837584.825933:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000609b8696 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036860928:0@lo:41: 00000100:00100000:1.0:1788837584.829553:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837584.829797:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036860928 00000100:00100000:0.0:1788837584.829816:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036860928 00000100:00100000:0.0:1788837584.829873:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837584.829881:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000476c505d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036860928:12345-0@lo:41: 00000004:00000024:0.0:1788837584.829920:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788837584.829969:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000476c505d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036860928:12345-0@lo:41: Request processed in 90us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837584.829976:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837584.834386:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000609b8696 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036860928:0@lo:41: 00010000:00010000:3.0:1788837585.595741:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837586.617063:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837587.644945:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837588.667954:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837588.921321:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2c97163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036861056:0@lo:41: 00000100:00100000:2.0:1788837588.921398:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837588.921448:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000282e5933 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036861568:0@lo:400: 00000100:00100000:2.0:1788837588.921472:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837588.921495:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837588.921500:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aef344b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036861440:0@lo:400: 00000100:00100000:2.0:1788837588.921521:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837588.921548:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec415c96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036861184:0@lo:400: 00000100:00100000:2.0:1788837588.921576:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837588.921598:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000074b6cf64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036861696:0@lo:400: 00000100:00100000:2.0:1788837588.921628:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837588.921644:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837588.921649:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e20eb47e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036861312:0@lo:400: 00000100:00100000:2.0:1788837588.921667:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837588.921697:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036861056 00000100:00100000:2.0:1788837588.921703:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036861056 00000100:00100000:2.0:1788837588.921735:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036861440 00000100:00100000:2.0:1788837588.921738:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036861440 00000100:00100000:2.0:1788837588.921749:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036861696 00000100:00100000:2.0:1788837588.921751:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036861696 00000100:00100000:2.0:1788837588.921771:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788837588.921795:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026dd6d6d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875732036861056:12345-0@lo:41: 00000004:00000024:2.0:1788837588.921829:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788837588.921870:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026dd6d6d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875732036861056:12345-0@lo:41: Request processed in 76us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837588.921877:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788837588.921893:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788837588.921897:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0ca504c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036861440:12345-0@lo:400: 00000100:00100000:2.0:1788837588.921923:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0ca504c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036861440:12345-0@lo:400: Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837588.921929:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788837588.921939:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788837588.921943:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007dcad813 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036861696:12345-0@lo:400: 00000100:00100000:2.0:1788837588.921969:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007dcad813 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036861696:12345-0@lo:400: Request processed in 26us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837588.921975:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788837588.922198:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036861568 00000100:00100000:2.0:1788837588.922203:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036861568 00000100:00100000:2.0:1788837588.922230:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036861312 00000100:00100000:2.0:1788837588.922232:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036861312 00000100:00100000:2.0:1788837588.922244:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788837588.922248:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084164ce1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036861568:12345-0@lo:400: 00000100:00100000:2.0:1788837588.922276:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084164ce1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036861568:12345-0@lo:400: Request processed in 28us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837588.922281:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788837588.922292:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788837588.922297:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028de6043 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036861312:12345-0@lo:400: 00000100:00100000:2.0:1788837588.922332:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028de6043 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036861312:12345-0@lo:400: Request processed in 35us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837588.922337:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788837588.928561:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036861184 00000100:00100000:2.0:1788837588.928578:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036861184 00000100:00100000:2.0:1788837588.928721:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788837588.928729:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a70a0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:3650:x1875732036861184:12345-0@lo:400: 00000100:00100000:2.0:1788837588.928835:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a70a0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:3650:x1875732036861184:12345-0@lo:400: Request processed in 107us (7258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837588.928843:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788837588.939449:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aef344b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036861440:0@lo:400: 00000100:00100000:0.0:1788837588.939481:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2c97163 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036861056:0@lo:41: 00010000:00080000:0.0:1788837588.939497:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000282e5933 x1875732036861568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837588.939507:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000282e5933 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036861568:0@lo:400: 00010000:00080000:2.0:1788837588.941762:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e20eb47e x1875732036861312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837588.941795:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e20eb47e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036861312:0@lo:400: 00000100:00100000:2.0:1788837588.941879:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec415c96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036861184:0@lo:400: 00000100:00100000:2.0:1788837588.941891:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000074b6cf64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036861696:0@lo:400: 00010000:00010000:2.0:1788837589.689942:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837589.948165:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837589.948188:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c16d7506 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036861824:0@lo:41: 00000100:00100000:3.0:1788837589.948256:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837589.948314:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036861824 00000100:00100000:3.0:1788837589.948328:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036861824 00000100:00100000:3.0:1788837589.948375:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837589.948383:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000499180f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036861824:12345-0@lo:41: 00000004:00000024:3.0:1788837589.948412:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788837589.948453:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000499180f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036861824:12345-0@lo:41: Request processed in 72us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837589.948471:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837589.948516:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c16d7506 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036861824:0@lo:41: 00010000:00010000:1.0:1788837590.715771:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788837590.972234:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788837590.972242:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ae7d4b000 from 1 10000000:01000000:2.0:1788837590.972258:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837590.972305:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000f38add32/0x57f6d4e926aeecee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837590.972319:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000f38add32/0x57f6d4e926aeecee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837590.972331:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000f38add32/0x57f6d4e926aeecee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837590.972378:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000074b6cf64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036861952:0@lo:101: 00000100:00100000:2.0:1788837590.972455:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837590.972512:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1ac0116 going to sleep for 11 seconds 00000100:00100000:2.0:1788837590.974353:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036861952 00000100:00100000:2.0:1788837590.974371:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036861952 00000100:00100000:2.0:1788837590.974444:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788837590.974454:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e39c36e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036861952:12345-0@lo:101: 00010000:00010000:2.0:1788837590.974472:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837590.974491:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c54524f/0x57f6d4e926aeecf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeecee expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837590.974518:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c54524f/0x57f6d4e926aeecf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeecee expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837590.974528:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c54524f/0x57f6d4e926aeecf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeecee expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837590.974536:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c54524f, rc 0) 00000100:00100000:2.0:1788837590.974683:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e39c36e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036861952:12345-0@lo:101: Request processed in 230us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837590.974689:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788837590.974751:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000074b6cf64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036861952:0@lo:101: 00010000:00010000:2.0:1788837590.974767:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000f38add32/0x57f6d4e926aeecee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeecf5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837590.974791:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000f38add32/0x57f6d4e926aeecee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeecf5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837590.975125:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000074b6cf64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036862080:0@lo:501: 00000100:00100000:2.0:1788837590.975160:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837590.976195:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036862080 00000100:00100000:1.0:1788837590.976203:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036862080 00000100:00100000:2.0:1788837590.976223:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1ac0116 going to sleep for 11 seconds 00000100:00100000:1.0:1788837590.976240:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788837590.976247:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000049da5e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036862080:12345-0@lo:501: 00000100:00100000:1.0:1788837590.976393:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000049da5e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036862080:12345-0@lo:501: Request processed in 146us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837590.976402:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788837590.977014:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000074b6cf64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036862080:0@lo:501: 00000100:00100000:2.0:1788837590.977072:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000074b6cf64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036862208:0@lo:503: 00000100:00100000:2.0:1788837590.977124:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837590.977146:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1ac0116 going to sleep for 11 seconds 00000100:00100000:1.0:1788837590.978200:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036862208 00000100:00100000:1.0:1788837590.978208:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036862208 00000100:00100000:1.0:1788837590.978257:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788837590.978265:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f78aa36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036862208:12345-0@lo:503: 00000100:00100000:1.0:1788837590.978401:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f78aa36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036862208:12345-0@lo:503: Request processed in 137us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837590.978408:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788837590.978483:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000074b6cf64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036862208:0@lo:503: 00000100:00100000:1.0:1788837590.987008:0:8233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000237405f7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8233:1875732036862336:0@lo:502: 00000100:00100000:1.0:1788837590.988440:0:8233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837590.988542:0:8233:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b4418b26 going to sleep for 11 seconds 00000100:00100000:2.0:1788837590.997062:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036862336 00000100:00100000:2.0:1788837590.997076:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036862336 00000100:00100000:1.0:1788837591.003537:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788837591.003550:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4bef01d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:8233:x1875732036862336:12345-0@lo:502: 00000100:00100000:1.0:1788837591.003824:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4bef01d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:8233:x1875732036862336:12345-0@lo:502: Request processed in 276us (15387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837591.003833:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788837591.003900:0:8233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000237405f7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8233:1875732036862336:0@lo:502: 00000020:01000000:1.0:1788837591.003936:0:8233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837591.003947:0:8233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837591.003949:0:8233:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788837591.003959:0:8233:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ae7d4b000 00000020:00000080:1.0:1788837591.003961:0:8233:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788837591.004015:0:8233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8233:1875732036862464:0@lo:502: 00000100:00100000:1.0:1788837591.004078:0:8233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837591.004107:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036862464 00000100:00100000:1.0:1788837591.004113:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036862464 00000100:00100000:1.0:1788837591.004139:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837591.004145:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:8233:x1875732036862464:12345-0@lo:502: 00000100:00100000:1.0:1788837591.004207:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:8233:x1875732036862464:12345-0@lo:502: Request processed in 61us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837591.004214:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837591.006380:0:8233:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded93900 going to sleep for 11 seconds 00000100:00100000:1.0:1788837591.006422:0:8233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8233:1875732036862464:0@lo:502: 00000020:01000000:1.0:1788837591.006462:0:8233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837591.006475:0:8233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837591.006477:0:8233:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788837591.006485:0:8233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788837591.006556:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788837591.006584:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788837591.006596:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889b02045800/0x57f6d4e926aeecee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeecf5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837591.006606:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889b02045800/0x57f6d4e926aeecee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeecf5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837591.006615:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788837591.006618:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ac3ec4000 from 1 10000000:01000000:1.0:1788837591.006620:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788837591.006654:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837591.007800:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837591.007814:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837591.007835:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036862592:0@lo:101: 00000100:00100000:1.0:1788837591.007895:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837591.007930:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0825000 going to sleep for 11 seconds 00000100:00100000:1.0:1788837591.007953:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036862592 00000100:00100000:1.0:1788837591.007959:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036862592 00000100:00100000:1.0:1788837591.008008:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788837591.008017:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036862592:12345-0@lo:101: 00010000:00010000:1.0:1788837591.008029:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837591.008065:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ad8ac7e00/0x57f6d4e926aeed03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeecfc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837591.008088:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ad8ac7e00/0x57f6d4e926aeed03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeecfc expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837591.008099:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ad8ac7e00/0x57f6d4e926aeed03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeecfc expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837591.008106:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ad8ac7e00, rc 0) 00000100:00100000:1.0:1788837591.008141:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036862592:12345-0@lo:101: Request processed in 126us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837591.008148:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788837591.008188:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036862592:0@lo:101: 00010000:00010000:1.0:1788837591.008201:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeed03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837591.008210:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeed03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837591.011849:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036862720:0@lo:501: 00000100:00100000:1.0:1788837591.011928:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837591.011971:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0825000 going to sleep for 11 seconds 00000100:00100000:1.0:1788837591.020888:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036862720 00000100:00100000:1.0:1788837591.020901:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036862720 00000100:00100000:1.0:1788837591.020954:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788837591.020964:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036862720:12345-0@lo:501: 00000100:00100000:1.0:1788837591.021138:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036862720:12345-0@lo:501: Request processed in 175us (9209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837591.021162:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788837591.021221:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036862720:0@lo:501: 00000100:00100000:1.0:1788837591.023383:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036862848:0@lo:503: 00000100:00100000:1.0:1788837591.025453:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837591.026115:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837591.026146:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036862848 00000100:00100000:1.0:1788837591.026154:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036862848 00000100:00100000:1.0:1788837591.027582:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788837591.027598:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036862848:12345-0@lo:503: 00000100:00100000:1.0:1788837591.028633:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036862848:12345-0@lo:503: Request processed in 1034us (3177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837591.028643:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788837591.040924:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036862848:0@lo:503: 00000100:00100000:3.0:1788837591.041811:0:8236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8236:1875732036862976:0@lo:502: 00000100:00100000:3.0:1788837591.041887:0:8236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837591.042328:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036862976 00000100:00100000:3.0:1788837591.042335:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036862976 00000100:00100000:3.0:1788837591.042391:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788837591.042399:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:8236:x1875732036862976:12345-0@lo:502: 00000100:00100000:3.0:1788837591.042729:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:8236:x1875732036862976:12345-0@lo:502: Request processed in 329us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837591.042737:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788837591.042814:0:8236:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7e99b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837591.042831:0:8236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8236:1875732036862976:0@lo:502: 00000020:01000000:3.0:1788837591.042858:0:8236:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837591.042867:0:8236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837591.042869:0:8236:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788837591.042876:0:8236:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ac3ec4000 00000020:00000080:3.0:1788837591.042878:0:8236:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788837591.042901:0:8236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8236:1875732036863104:0@lo:502: 00000100:00100000:3.0:1788837591.043280:0:8236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837591.043305:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036863104 00000100:00100000:3.0:1788837591.043310:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036863104 00000100:00100000:3.0:1788837591.043335:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788837591.043342:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:8236:x1875732036863104:12345-0@lo:502: 00000100:00100000:3.0:1788837591.048861:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:8236:x1875732036863104:12345-0@lo:502: Request processed in 5508us (5572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837591.048894:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788837591.048971:0:8236:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7e99b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837591.048998:0:8236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8236:1875732036863104:0@lo:502: 00000020:01000000:3.0:1788837591.049031:0:8236:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837591.049050:0:8236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837591.049053:0:8236:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788837591.049058:0:8236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788837591.050263:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788837591.050287:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837591.050298:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeed03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837591.050308:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeed03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837591.737926:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837592.765160:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837593.785323:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837594.043128:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837594.043149:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036863232:0@lo:41: 00000100:00100000:0.0:1788837594.043220:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837594.043983:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036863232 00000100:00100000:2.0:1788837594.044002:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036863232 00000100:00100000:2.0:1788837594.044079:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788837594.044088:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036863232:12345-0@lo:41: 00000004:00000024:2.0:1788837594.044119:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788837594.044170:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036863232:12345-0@lo:41: Request processed in 83us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837594.044177:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837594.045177:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036863744:0@lo:400: 00000100:00100000:3.0:1788837594.045218:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837594.045244:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837594.045250:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036863360:0@lo:400: 00000100:00100000:3.0:1788837594.045271:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837594.045298:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036863488:0@lo:400: 00000100:00100000:3.0:1788837594.045316:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837594.045329:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837594.045334:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036863616:0@lo:400: 00000100:00100000:3.0:1788837594.045351:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837594.047090:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036863744 00000100:00100000:3.0:1788837594.047102:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036863744 00000100:00100000:3.0:1788837594.047154:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036863488 00000100:00100000:3.0:1788837594.047158:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036863488 00000100:00100000:3.0:1788837594.047173:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837594.047180:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036863744:12345-0@lo:400: 00000100:00100000:3.0:1788837594.047748:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036863744:12345-0@lo:400: Request processed in 567us (2528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837594.047757:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837594.047773:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788837594.047796:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036863488:12345-0@lo:400: 00000100:00100000:3.0:1788837594.047825:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036863488:12345-0@lo:400: Request processed in 31us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837594.047831:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788837594.047849:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036863360 00000100:00100000:3.0:1788837594.047853:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036863360 00000100:00100000:3.0:1788837594.047889:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788837594.047896:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:3648:x1875732036863360:12345-0@lo:400: 00000100:00100000:3.0:1788837594.047921:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:3648:x1875732036863360:12345-0@lo:400: Request processed in 26us (2649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837594.047926:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1788837594.047977:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889ae7e3f800 x1875732036863488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837594.048002:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036863488:0@lo:400: 00000100:00100000:3.0:1788837594.048028:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036863360:0@lo:400: 00010000:00080000:3.0:1788837594.048038:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889ae7e3e680 x1875732036863744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837594.048047:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036863744:0@lo:400: 00000100:00100000:1.0:1788837594.048164:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036863616 00000100:00100000:1.0:1788837594.048169:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036863616 00000100:00100000:1.0:1788837594.048192:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837594.048995:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036863232:0@lo:41: 00000100:00100000:1.0:1788837594.049075:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036863616:12345-0@lo:400: 00000100:00100000:1.0:1788837594.049133:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036863616:12345-0@lo:400: Request processed in 62us (3781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837594.049139:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837594.049214:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036863616:0@lo:400: 00010000:00010000:1.0:1788837594.808990:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837595.066336:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837595.066361:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036863872:0@lo:41: 00000100:00100000:3.0:1788837595.066431:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837595.066506:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036863872 00000100:00100000:3.0:1788837595.066513:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036863872 00000100:00100000:3.0:1788837595.066563:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788837595.066572:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036863872:12345-0@lo:41: 00000004:00000024:3.0:1788837595.066605:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788837595.066651:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036863872:12345-0@lo:41: Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.066658:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788837595.066706:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036863872:0@lo:41: 00000020:01000004:3.0:1788837595.193700:0:8432:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788837595.193714:0:8432:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788837595.193717:0:8432:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788837595.193926:0:8432:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff889afa550800 00000020:01000004:3.0:1788837595.193946:0:8432:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788837595.193960:0:8432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788837595.193987:0:8432:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff889ac848cd28) 00000020:00000080:3.0:1788837595.194016:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788837595.276144:0:8432:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788837595.276270:0:8432:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788837595.318837:0:8432:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788837595.319045:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788837595.319056:0:8432:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788837595.319066:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x57f6d4e926aeed11 00000020:01000004:2.0:1788837595.319072:0:8432:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788837595.319100:0:8432:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788837595.319104:0:8432:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788837595.319113:0:8432:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788837595.319118:0:8432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788837595.319135:0:8432:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff889af758b370) 00000020:00000080:2.0:1788837595.319146:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788837595.325124:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837595.325338:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788837595.325344:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788837595.334307:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788837595.334320:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788837595.338216:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788837595.338230:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788837595.354452:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837595.354703:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788837595.354711:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788837595.369692:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788837595.369708:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788837595.418559:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837595.418904:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788837595.418911:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788837595.424387:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788837595.424576:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788837595.434617:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788837595.434633:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788837595.438691:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837595.438944:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788837595.438951:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788837595.439906:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788837595.439920:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788837595.545756:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837595.546611:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788837595.546620:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788837595.555078:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788837595.561273:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788837595.573588:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788837595.580463:0:8432:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788837595.580475:0:8432:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788837595.615271:0:8432:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788837595.615316:0:8432:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.103@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788837595.615321:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788837595.615323:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788837595.615325:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837595.615326:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837595.615327:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837595.615329:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837595.615330:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837595.615332:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788837595.615333:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788837595.615335:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837595.615336:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788837595.615341:0:8432:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788837595.615344:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788837595.615345:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788837595.615350:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837595.615351:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837595.615352:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837595.615353:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837595.615354:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837595.615355:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788837595.615356:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788837595.615356:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837595.615357:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788837595.615500:0:8432:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788837595.615519:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036864000:0@lo:253: 00000100:00100000:2.0:1788837595.615601:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837595.615704:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad15a2900 going to sleep for 11 seconds 00000100:00100000:1.0:1788837595.615755:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036864000 00000100:00100000:1.0:1788837595.615764:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036864000 00000100:00100000:2.0:1788837595.616130:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788837595.616141:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:8432:x1875732036864000:12345-0@lo:253: 20000000:01000000:2.0:1788837595.616182:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788837595.616187:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788837595.616192:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788837595.616196:0:6518:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788837595.616564:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837595.616715:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788837595.616729:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788837595.616746:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788837595.616751:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788837595.616763:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788837595.616812:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788837595.616898:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788837595.616912:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.103@tcp 20000000:01000000:2.0:1788837595.616914:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:2.0:1788837595.616929:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788837595.616935:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788837595.616949:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788837595.616955:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:2.0:1788837595.616993:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788837595.617118:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788837595.617136:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788837595.617153:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788837595.617298:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788837595.617310:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.103@tcp 20000000:01000000:2.0:1788837595.617311:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:2.0:1788837595.617326:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788837595.617332:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788837595.617361:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788837595.617368:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:2.0:1788837595.617383:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788837595.617389:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788837595.617484:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788837595.617502:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788837595.617893:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788837595.617907:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.103@tcp 20000000:01000000:2.0:1788837595.617909:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:2.0:1788837595.617923:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788837595.617930:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788837595.617943:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788837595.617948:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:2.0:1788837595.622589:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788837595.622627:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788837595.622673:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788837595.622689:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788837595.622713:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788837595.622715:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788837595.622720:0:6518:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788837595.622769:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788837595.622771:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788837595.631136:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788837595.631295:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788837595.631318:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788837595.631731:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788837595.631754:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788837595.631769:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1788837595.631957:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788837595.631970:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788837595.632487:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1788837595.632514:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1788837595.632529:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788837595.632681:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788837595.632698:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788837595.632712:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788837595.632720:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788837595.632722:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788837595.634262:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1788837595.634298:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1788837595.634311:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788837595.634702:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788837595.634725:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788837595.634740:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1788837595.634751:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788837595.634754:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788837595.635388:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788837595.635633:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788837595.635655:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788837595.635670:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:2.0:1788837595.635684:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788837595.635703:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.635720:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ad8ac6a00/0x57f6d4e926aeebeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeebe4 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.635727:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889b02171600/0x57f6d4e926aeec62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeec5b expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.635733:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926aeec9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeec93 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.635739:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889b02170a00/0x57f6d4e926aeecb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeecaf expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.635759:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889b02045e00/0x57f6d4e926aeece0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeecd9 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.635766:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.635990:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889b02045e00/0x57f6d4e926aeece0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeecd9 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.636098:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889b02045e00/0x57f6d4e926aeece0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeecd9 expref: 18 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.636112:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ef800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036864128:0@lo:104: 00000100:00100000:2.0:1788837595.636250:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837595.636351:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889b02170a00/0x57f6d4e926aeecb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeecaf expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.636359:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889b02170a00/0x57f6d4e926aeecb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeecaf expref: 18 pid: 6518 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.636369:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5edc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036864256:0@lo:104: 00000100:00100000:2.0:1788837595.636401:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837595.636540:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926aeec9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeec93 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.636549:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926aeec9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeec93 expref: 18 pid: 6518 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.636558:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5efb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036864384:0@lo:104: 00000100:00100000:2.0:1788837595.636590:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837595.636652:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036864128 00000100:00100000:3.0:1788837595.636660:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036864128 00000100:00100000:3.0:1788837595.636700:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036864256 00000100:00100000:3.0:1788837595.636703:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036864256 00000100:00100000:3.0:1788837595.636719:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788837595.636728:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6518:x1875732036864128:12345-0@lo:104: 00010000:00010000:3.0:1788837595.636740:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac0030e00/0x57f6d4e926aeecd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeece0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.636816:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837595.636822:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6518:x1875732036864128:12345-0@lo:104: Request processed in 95us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.636829:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788837595.636845:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837595.636851:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6518:x1875732036864256:12345-0@lo:104: 00010000:00010000:3.0:1788837595.636858:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7c00/0x57f6d4e926aeecaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeecb6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.636885:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788837595.636890:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6518:x1875732036864256:12345-0@lo:104: Request processed in 40us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.636895:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788837595.637025:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837595.637033:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac0030e00/0x57f6d4e926aeecd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeece0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.637040:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0030e00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837595.637044:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac0030e00/0x57f6d4e926aeecd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeece0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.637053:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac0030e00/0x57f6d4e926aeecd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeece0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837595.637060:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac0030e00/0x57f6d4e926aeecd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeece0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837595.637065:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837595.637091:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac0030e00/0x57f6d4e926aeecd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeece0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.637097:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837595.637116:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac0030e00/0x57f6d4e926aeecd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeece0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.637123:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac0030e00/0x57f6d4e926aeecd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeece0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.637136:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837595.637140:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7c00/0x57f6d4e926aeecaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeecb6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.637154:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac7c00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837595.637157:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7c00/0x57f6d4e926aeecaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeecb6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.637163:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7c00/0x57f6d4e926aeecaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeecb6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837595.637180:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7c00/0x57f6d4e926aeecaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeecb6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837595.637185:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837595.637201:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7c00/0x57f6d4e926aeecaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeecb6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.637206:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837595.637212:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7c00/0x57f6d4e926aeecaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeecb6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.637218:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7c00/0x57f6d4e926aeecaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeecb6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.637227:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837595.637229:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837595.637230:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837595.637238:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837595.637253:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036864512:0@lo:103: 00000100:00100000:1.0:1788837595.637286:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837595.637323:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837595.637329:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036864640:0@lo:103: 00000100:00100000:1.0:1788837595.637359:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837595.637421:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036864512 00000100:00100000:1.0:1788837595.637426:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036864512 00010000:00010000:1.0:1788837595.637444:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889b02045e00/0x57f6d4e926aeece0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeecd9 expref: 19 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837595.637464:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036864640 00000100:00100000:1.0:1788837595.637467:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036864640 00010000:00010000:1.0:1788837595.637479:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889b02170a00/0x57f6d4e926aeecb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeecaf expref: 20 pid: 6518 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837595.637492:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837595.637498:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:3650:x1875732036864512:12345-0@lo:103: 00010000:00010000:1.0:1788837595.637507:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837595.637512:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889b02045e00/0x57f6d4e926aeece0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeecd9 expref: 20 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.637522:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889b02045e00/0x57f6d4e926aeece0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeecd9 expref: 20 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.637538:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837595.637568:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:3650:x1875732036864512:12345-0@lo:103: Request processed in 70us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837595.637575:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837595.637590:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837595.637595:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:3650:x1875732036864640:12345-0@lo:103: 00010000:00010000:1.0:1788837595.637602:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837595.637606:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889b02170a00/0x57f6d4e926aeecb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeecaf expref: 19 pid: 6518 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.637626:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889b02170a00/0x57f6d4e926aeecb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeecaf expref: 19 pid: 6518 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.637636:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837595.637658:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:3650:x1875732036864640:12345-0@lo:103: Request processed in 63us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837595.637664:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837595.637716:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036864640:0@lo:103: 00000100:00100000:1.0:1788837595.637725:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036864512:0@lo:103: 00010000:00010000:2.0:1788837595.638448:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889b02171600/0x57f6d4e926aeec62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeec5b expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.638462:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889b02171600/0x57f6d4e926aeec62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeec5b expref: 18 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.638472:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ee680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036864768:0@lo:104: 00000100:00100000:2.0:1788837595.638503:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837595.638700:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ad8ac6a00/0x57f6d4e926aeebeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeebe4 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.638709:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ad8ac6a00/0x57f6d4e926aeebeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeebe4 expref: 18 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.638717:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036864896:0@lo:104: 00000100:00100000:2.0:1788837595.638740:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837595.638755:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036864384 00000100:00100000:0.0:1788837595.638760:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036864384 00000100:00100000:0.0:1788837595.638814:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036864768 00000100:00100000:0.0:1788837595.638817:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036864768 00000100:00100000:0.0:1788837595.638831:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837595.638838:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6518:x1875732036864384:12345-0@lo:104: 00010000:00010000:0.0:1788837595.638848:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6200/0x57f6d4e926aeec93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeec9a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.638891:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837595.638896:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6518:x1875732036864384:12345-0@lo:104: Request processed in 59us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837595.638901:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837595.638915:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788837595.638921:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6518:x1875732036864768:12345-0@lo:104: 00010000:00010000:0.0:1788837595.638928:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889b02044000/0x57f6d4e926aeec5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeec62 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.638971:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788837595.638977:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6518:x1875732036864768:12345-0@lo:104: Request processed in 56us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837595.638982:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788837595.639011:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837595.639015:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6200/0x57f6d4e926aeec93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeec9a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.639022:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac6200 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837595.639026:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6200/0x57f6d4e926aeec93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeec9a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.639045:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6200/0x57f6d4e926aeec93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeec9a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837595.639053:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6200/0x57f6d4e926aeec93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeec9a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837595.639058:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837595.639085:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6200/0x57f6d4e926aeec93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec9a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.639092:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837595.639107:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6200/0x57f6d4e926aeec93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec9a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.639114:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6200/0x57f6d4e926aeec93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec9a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.639127:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837595.639131:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889b02044000/0x57f6d4e926aeec5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeec62 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.639136:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889b02044000 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837595.639138:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889b02044000/0x57f6d4e926aeec5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeec62 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.639146:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889b02044000/0x57f6d4e926aeec5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeec62 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837595.639152:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889b02044000/0x57f6d4e926aeec5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeec62 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837595.639173:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837595.639189:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889b02044000/0x57f6d4e926aeec5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec62 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.639195:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837595.639200:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889b02044000/0x57f6d4e926aeec5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec62 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.639207:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889b02044000/0x57f6d4e926aeec5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec62 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.639217:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837595.639219:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837595.639220:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837595.639238:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036865024:0@lo:103: 00000100:00100000:0.0:1788837595.639266:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837595.639287:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837595.639293:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036865152:0@lo:103: 00000100:00100000:0.0:1788837595.639312:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837595.639339:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036865024 00000100:00100000:0.0:1788837595.639343:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036865024 00010000:00010000:0.0:1788837595.639358:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926aeec9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeec93 expref: 19 pid: 6518 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837595.639376:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036865152 00000100:00100000:0.0:1788837595.639379:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036865152 00010000:00010000:1.0:1788837595.639548:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837595.639723:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889b02171600/0x57f6d4e926aeec62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeec5b expref: 20 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837595.639754:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837595.639762:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:3648:x1875732036865024:12345-0@lo:103: 00010000:00010000:0.0:1788837595.639773:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837595.639816:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926aeec9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeec93 expref: 20 pid: 6518 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.639826:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926aeec9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeec93 expref: 20 pid: 6518 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.639841:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837595.639874:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:3648:x1875732036865024:12345-0@lo:103: Request processed in 114us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837595.639881:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837595.639893:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788837595.639898:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:3648:x1875732036865152:12345-0@lo:103: 00010000:00010000:0.0:1788837595.639905:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837595.639909:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889b02171600/0x57f6d4e926aeec62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeec5b expref: 19 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.639917:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889b02171600/0x57f6d4e926aeec62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeec5b expref: 19 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.639926:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837595.639944:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:3648:x1875732036865152:12345-0@lo:103: Request processed in 46us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837595.639949:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788837595.640057:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036865152:0@lo:103: 00000100:00100000:1.0:1788837595.640065:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036865024:0@lo:103: 00000100:00100000:2.0:1788837595.640362:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad15a2b40 going to sleep for 11 seconds 00010000:00010000:2.0:1788837595.640379:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889b02045e00/0x57f6d4e926aeece0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeecd9 expref: 18 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.640460:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ef800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036864128:0@lo:104: 00010000:00010000:2.0:1788837595.640476:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889b02170a00/0x57f6d4e926aeecb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeecaf expref: 17 pid: 6518 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.640486:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5edc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036864256:0@lo:104: 00010000:00010000:2.0:1788837595.640496:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b16c00/0x57f6d4e926aeec9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeec93 expref: 16 pid: 6518 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.640504:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5efb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036864384:0@lo:104: 00010000:00010000:2.0:1788837595.640528:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889b02171600/0x57f6d4e926aeec62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeec5b expref: 15 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.640537:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ee680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036864768:0@lo:104: 00000100:00100000:0.0:1788837595.640579:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036864896 00000100:00100000:0.0:1788837595.640589:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036864896 00000100:00100000:0.0:1788837595.640659:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788837595.640667:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6518:x1875732036864896:12345-0@lo:104: 00010000:00010000:0.0:1788837595.640676:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889b02045400/0x57f6d4e926aeebe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeebeb expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.640730:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837595.640736:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6518:x1875732036864896:12345-0@lo:104: Request processed in 71us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837595.640742:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788837595.640796:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837595.640802:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889b02045400/0x57f6d4e926aeebe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeebeb expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.640809:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889b02045400 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837595.640813:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889b02045400/0x57f6d4e926aeebe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeebeb expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.640822:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889b02045400/0x57f6d4e926aeebe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeebeb expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837595.640828:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889b02045400/0x57f6d4e926aeebe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeebeb expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837595.640844:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837595.640871:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889b02045400/0x57f6d4e926aeebe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeebeb expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.640877:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837595.640890:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889b02045400/0x57f6d4e926aeebe4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeebeb expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.640896:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889b02045400/0x57f6d4e926aeebe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeebeb expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.640909:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837595.640910:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837595.640912:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837595.640917:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837595.640927:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036865280:0@lo:103: 00000100:00100000:1.0:1788837595.640977:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837595.641028:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036865280 00000100:00100000:1.0:1788837595.641032:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036865280 00010000:00010000:1.0:1788837595.641048:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ad8ac6a00/0x57f6d4e926aeebeb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeebe4 expref: 15 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837595.641068:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837595.641074:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8564050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:3651:x1875732036865280:12345-0@lo:103: 00010000:00010000:1.0:1788837595.641082:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837595.641087:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ad8ac6a00/0x57f6d4e926aeebeb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeebe4 expref: 15 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.641096:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ad8ac6a00/0x57f6d4e926aeebeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeebe4 expref: 15 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.641117:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.641126:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.641141:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.641149:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.641155:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.641162:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.641178:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889b02044c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837595.641182:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.641189:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.641199:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.641208:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837595.641237:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8564050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:3651:x1875732036865280:12345-0@lo:103: Request processed in 163us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837595.641252:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837595.641305:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036865280:0@lo:103: 00010000:00010000:2.0:1788837595.641543:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ad8ac6a00/0x57f6d4e926aeebeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeebe4 expref: 14 pid: 6516 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.641554:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036864896:0@lo:104: 00010000:00010000:2.0:1788837595.641575:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.641583:0:6518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.641589:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.641595:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889b02044c00/0x57f6d4e926aeed1f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788837595.641609:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788837595.643871:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:8432:x1875732036864000:12345-0@lo:253: Request processed in 27723us (28262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837595.643886:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788837595.644024:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036864000:0@lo:253: 10000000:01000000:2.0:1788837595.644039:0:8432:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788837595.644043:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788837595.644044:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788837595.644046:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837595.644047:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788837595.644048:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837595.644049:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837595.644051:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837595.644052:0:8432:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788837595.644063:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837595.644065:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788837595.644085:0:8432:0:(tgt_mount.c:101:server_register_mount()) register mount ffff889afa550800 from lustre-OST0000 10000000:01000000:2.0:1788837595.644115:0:8432:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788837595.644118:0:8432:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788837595.644127:0:8432:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff889ac85799b8 local copy 10000000:01000000:2.0:1788837595.644131:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788837595.644176:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.644187:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.644197:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.644215:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036865408:0@lo:101: 00000100:00100000:2.0:1788837595.644251:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837595.644294:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad15a2600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837595.644399:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036865408 00000100:00100000:1.0:1788837595.644405:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036865408 00000100:00100000:1.0:1788837595.644449:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788837595.644457:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:8432:x1875732036865408:12345-0@lo:101: 00010000:00010000:1.0:1788837595.644468:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837595.644481:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aeed2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeed26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.644502:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aeed2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeed26 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.644512:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aeed2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeed26 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.644520:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9a00, rc 0) 00000100:00100000:1.0:1788837595.644550:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:8432:x1875732036865408:12345-0@lo:101: Request processed in 94us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837595.644555:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788837595.644889:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036865408:0@lo:101: 00010000:00010000:2.0:1788837595.644902:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x57f6d4e926aeed2d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.644910:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x57f6d4e926aeed2d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.645001:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036865536:0@lo:501: 00000100:00100000:2.0:1788837595.645025:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837595.645042:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad15a2600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837595.645099:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036865536 00000100:00100000:1.0:1788837595.645103:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036865536 00000100:00100000:1.0:1788837595.645134:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837595.645140:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:8432:x1875732036865536:12345-0@lo:501: 00000100:00100000:1.0:1788837595.645216:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:8432:x1875732036865536:12345-0@lo:501: Request processed in 75us (188us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788837595.645223:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837595.645251:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036865536:0@lo:501: 10000000:01000000:1.0:1788837595.645262:0:8432:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788837595.645276:0:8432:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788837595.645281:0:8432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x57f6d4e926aeed2d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.645288:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x57f6d4e926aeed2d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.645295:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x57f6d4e926aeed2d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.645310:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788837595.645330:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff889afa550800 00010000:00010000:1.0:1788837595.645339:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837595.645345:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x57f6d4e926aeed2d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.645352:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889b02045000 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837595.645355:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x57f6d4e926aeed2d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.645363:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x57f6d4e926aeed2d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837595.645369:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x57f6d4e926aeed2d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837595.645381:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837595.645539:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x57f6d4e926aeed2d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.645546:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837595.645571:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x57f6d4e926aeed2d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.645577:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889b02045000/0x57f6d4e926aeed26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x57f6d4e926aeed2d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.645593:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837595.645594:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837595.645596:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837595.645603:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837595.645613:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036865664:0@lo:103: 00000100:00100000:1.0:1788837595.645641:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1788837595.645682:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788837595.645688:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788837595.645691:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788837595.645695:0:8432:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788837595.645698:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788837595.645714:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.645721:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.645728:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837595.645745:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036865792:0@lo:101: 00000100:00100000:1.0:1788837595.645773:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837595.645814:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837595.645873:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036865792 00000100:00100000:2.0:1788837595.645878:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036865792 00000100:00100000:2.0:1788837595.645920:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788837595.645926:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:8432:x1875732036865792:12345-0@lo:101: 00010000:00010000:2.0:1788837595.645933:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837595.645943:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889b02171c00/0x57f6d4e926aeed3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeed34 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.645969:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889b02171c00/0x57f6d4e926aeed3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeed34 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.645979:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889b02171c00/0x57f6d4e926aeed3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeed34 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.645987:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889b02171c00, rc 0) 00000100:00100000:2.0:1788837595.646027:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036865792:12345-0@lo:101: Request processed in 101us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837595.646033:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788837595.646555:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036865792:0@lo:101: 00010000:00010000:1.0:1788837595.646570:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeed3b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.646579:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeed3b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837595.646646:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036865920:0@lo:501: 00000100:00100000:1.0:1788837595.646674:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837595.646698:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837595.646744:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036865920 00000100:00100000:2.0:1788837595.646749:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036865920 00000100:00100000:2.0:1788837595.646806:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788837595.646814:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036865920:12345-0@lo:501: 00000100:00100000:2.0:1788837595.646903:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036865920:12345-0@lo:501: Request processed in 89us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837595.646910:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788837595.647271:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036865920:0@lo:501: 00000100:00100000:1.0:1788837595.647299:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866048:0@lo:503: 00000100:00100000:1.0:1788837595.647342:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837595.647363:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837595.647513:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036866048 00000100:00100000:3.0:1788837595.647517:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036866048 00000100:00100000:3.0:1788837595.647555:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788837595.647564:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036866048:12345-0@lo:503: 00000100:00100000:3.0:1788837595.647659:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036866048:12345-0@lo:503: Request processed in 96us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.647685:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788837595.647828:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866048:0@lo:503: 00000040:00080000:1.0:1788837595.648104:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788837595.648279:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036865664 00000100:00100000:2.0:1788837595.648285:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036865664 00000100:00100000:2.0:1788837595.648319:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837595.648326:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:3650:x1875732036865664:12345-0@lo:103: 00010000:00010000:2.0:1788837595.648336:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837595.648356:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aeed2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aeed26 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.648372:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837595.648484:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:3650:x1875732036865664:12345-0@lo:103: Request processed in 158us (2841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837595.648490:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837595.648518:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036865664:0@lo:103: 00000100:00100000:1.0:1788837595.648663:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866176:0@lo:502: 00000100:00100000:1.0:1788837595.648706:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837595.648770:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837595.648979:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036866176 00000100:00100000:2.0:1788837595.648984:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036866176 00000100:00100000:2.0:1788837595.649100:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788837595.649108:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:8432:x1875732036866176:12345-0@lo:502: 00000100:00100000:2.0:1788837595.649313:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:8432:x1875732036866176:12345-0@lo:502: Request processed in 206us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837595.649321:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788837595.649469:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866176:0@lo:502: 00000040:00080000:1.0:1788837595.649708:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788837595.649742:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788837595.649754:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788837595.649765:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788837595.649989:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788837595.650081:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788837595.650109:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866304:0@lo:502: 00000100:00100000:1.0:1788837595.650155:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837595.650292:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837595.650368:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036866304 00000100:00100000:2.0:1788837595.650374:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036866304 00000100:00100000:2.0:1788837595.650504:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788837595.650512:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:8432:x1875732036866304:12345-0@lo:502: 00000100:00100000:2.0:1788837595.650619:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:8432:x1875732036866304:12345-0@lo:502: Request processed in 107us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837595.650626:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788837595.650709:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866304:0@lo:502: 00000040:00080000:0.0:1788837595.650756:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788837595.650764:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788837595.652369:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788837595.652379:0:8455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788837595.652386:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837595.652388:0:8455:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788837595.652469:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788837595.652487:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff889ae7f3b370) 00000020:00000080:1.0:1788837595.652509:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788837595.652516:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788837595.652601:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889afa550800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788837595.652609:0:8455:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788837595.652616:0:8455:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x57f6d4e926aeed49 00010000:00010000:1.0:1788837595.659283:0:8455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1788837595.659686:0:8455:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788837595.663098:0:8455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788837595.663493:0:8455:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788837595.668106:0:8455:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788837595.668310:0:8455:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788837595.677348:0:8455:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788837595.678946:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788837595.679143:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837595.679330:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837595.679333:0:8455:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788837595.679339:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837595.679344:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837595.679345:0:8455:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788837595.679349:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788837595.679351:0:8455:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788837595.679383:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837595.679387:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837595.679461:0:8455:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788837595.679466:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788837595.679656:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788837595.679684:0:8432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788837595.679704:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeed3b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.679717:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeed3b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837595.679726:0:8432:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889afa550800 from 1 10000000:01000000:0.0:1788837595.679729:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837595.679766:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.679799:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.679811:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837595.679839:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866432:0@lo:101: 00000100:00100000:0.0:1788837595.679906:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837595.679944:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837595.680082:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036866432 00000100:00100000:2.0:1788837595.680090:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036866432 00000100:00100000:2.0:1788837595.680135:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788837595.680145:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:8432:x1875732036866432:12345-0@lo:101: 00010000:00010000:2.0:1788837595.680157:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837595.680333:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889b02171600/0x57f6d4e926aeed57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeed50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.680371:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889b02171600/0x57f6d4e926aeed57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeed50 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.680383:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889b02171600/0x57f6d4e926aeed57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeed50 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.680455:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889b02171600, rc 0) 00000100:00100000:2.0:1788837595.680505:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036866432:12345-0@lo:101: Request processed in 361us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837595.680512:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788837595.680601:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866432:0@lo:101: 00010000:00010000:0.0:1788837595.680616:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeed57 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.680625:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeed57 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837595.680709:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866560:0@lo:501: 00000100:00100000:0.0:1788837595.680736:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837595.680768:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837595.680874:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036866560 00000100:00100000:2.0:1788837595.680879:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036866560 00000100:00100000:2.0:1788837595.680902:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788837595.680909:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036866560:12345-0@lo:501: 00000100:00100000:2.0:1788837595.681011:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036866560:12345-0@lo:501: Request processed in 102us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837595.681018:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788837595.681263:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866560:0@lo:501: 00000100:00100000:0.0:1788837595.681288:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866688:0@lo:503: 00000100:00100000:0.0:1788837595.681327:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837595.681354:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837595.681468:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036866688 00000100:00100000:2.0:1788837595.681473:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036866688 00000100:00100000:2.0:1788837595.681502:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788837595.681509:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036866688:12345-0@lo:503: 00000100:00100000:2.0:1788837595.681594:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036866688:12345-0@lo:503: Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837595.681600:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788837595.681702:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866688:0@lo:503: 00000040:00080000:0.0:1788837595.681977:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788837595.682240:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866816:0@lo:502: 00000100:00100000:0.0:1788837595.682276:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837595.682301:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837595.682369:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036866816 00000100:00100000:2.0:1788837595.682373:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036866816 00000100:00100000:2.0:1788837595.682524:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788837595.682534:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036866816:12345-0@lo:502: 00000100:00100000:2.0:1788837595.682628:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036866816:12345-0@lo:502: Request processed in 96us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837595.682635:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788837595.682704:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866816:0@lo:502: 00000040:00080000:0.0:1788837595.682916:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788837595.682947:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788837595.682979:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866944:0@lo:502: 00000100:00100000:0.0:1788837595.683010:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837595.687360:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837595.687495:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036866944 00000100:00100000:1.0:1788837595.687505:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036866944 00000100:00100000:1.0:1788837595.688157:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788837595.688249:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036866944:12345-0@lo:502: 00000100:00100000:1.0:1788837595.688484:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036866944:12345-0@lo:502: Request processed in 238us (5472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837595.688492:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788837595.690201:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036866944:0@lo:502: 00000040:00080000:0.0:1788837595.690298:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788837595.690311:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788837595.691340:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837595.691351:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837595.691353:0:8459:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788837595.691360:0:8459:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889afa550800 00000020:00000080:0.0:1788837595.691363:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788837595.691374:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837595.691377:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837595.691378:0:8459:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788837595.691381:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788837595.691589:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788837595.691616:0:8432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837595.691678:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeed57 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.691690:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeed57 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837595.691736:0:8432:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788837595.691739:0:8432:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff889afa550800 10000000:01000000:2.0:1788837595.691742:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff889afa550800 10000000:01000000:2.0:1788837595.691745:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837595.691751:0:8432:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889afa550800 from 1 10000000:01000000:2.0:1788837595.691754:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788837595.691835:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.691854:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.691863:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.691884:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036867072:0@lo:101: 00000100:00100000:2.0:1788837595.691948:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837595.691990:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad15a2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837595.692062:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036867072 00000100:00100000:0.0:1788837595.692069:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036867072 00000100:00100000:0.0:1788837595.692112:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788837595.692121:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8432:x1875732036867072:12345-0@lo:101: 00010000:00010000:0.0:1788837595.692134:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837595.692146:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeed65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeed5e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.692300:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeed65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeed5e expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.692312:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeed65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeed5e expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.692332:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0030e00, rc 0) 00000100:00100000:0.0:1788837595.692377:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:8432:x1875732036867072:12345-0@lo:101: Request processed in 257us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837595.692383:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788837595.692441:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036867072:0@lo:101: 00010000:00010000:0.0:1788837595.692455:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeed65 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837595.692464:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeed65 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837595.692539:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036867200:0@lo:501: 00000100:00100000:0.0:1788837595.692565:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837595.692577:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837595.692733:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036867200 00000100:00100000:2.0:1788837595.692738:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036867200 00000100:00100000:2.0:1788837595.692770:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788837595.692807:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:8432:x1875732036867200:12345-0@lo:501: 00000100:00100000:2.0:1788837595.692892:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:8432:x1875732036867200:12345-0@lo:501: Request processed in 116us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837595.692898:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788837595.693032:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036867200:0@lo:501: 00000100:00100000:0.0:1788837595.693131:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036867328:0@lo:503: 00000100:00100000:0.0:1788837595.693244:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837595.693273:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837595.693318:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036867328 00000100:00100000:2.0:1788837595.693322:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036867328 00000100:00100000:2.0:1788837595.693398:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788837595.693406:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:8432:x1875732036867328:12345-0@lo:503: 00000100:00100000:2.0:1788837595.693496:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:8432:x1875732036867328:12345-0@lo:503: Request processed in 91us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837595.693503:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788837595.693683:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036867328:0@lo:503: 00000040:00080000:0.0:1788837595.693910:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788837595.693979:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036867456:0@lo:502: 00000100:00100000:0.0:1788837595.694012:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837595.694314:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837595.694452:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036867456 00000100:00100000:3.0:1788837595.694459:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036867456 00000100:00100000:3.0:1788837595.694491:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788837595.694498:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:8432:x1875732036867456:12345-0@lo:502: 00000100:00100000:3.0:1788837595.694601:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:8432:x1875732036867456:12345-0@lo:502: Request processed in 102us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.694608:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788837595.694684:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036867456:0@lo:502: 00000040:00080000:0.0:1788837595.694910:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788837595.694940:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788837595.694955:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788837595.695000:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788837595.695016:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788837595.695029:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788837595.695054:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788837595.695070:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788837595.695082:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788837595.695096:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788837595.695109:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788837595.695122:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788837595.695136:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788837595.695150:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788837595.695572:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788837595.695596:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788837595.695610:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788837595.695622:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788837595.695634:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788837595.695663:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788837595.695678:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788837595.695691:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788837595.695703:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788837595.695716:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788837595.695729:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788837595.695741:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788837595.695754:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788837595.695767:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788837595.695807:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788837595.695823:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788837595.695837:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788837595.695849:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788837595.695872:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788837595.695885:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788837595.695896:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788837595.695916:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788837595.695927:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1788837595.695972:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036867584:0@lo:502: 00000100:00100000:0.0:1788837595.696030:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837595.696067:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837595.696262:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036867584 00000100:00100000:3.0:1788837595.696268:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036867584 00000100:00100000:3.0:1788837595.696303:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788837595.696310:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:8432:x1875732036867584:12345-0@lo:502: 00000100:00100000:3.0:1788837595.696487:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:8432:x1875732036867584:12345-0@lo:502: Request processed in 176us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.696494:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788837595.696626:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036867584:0@lo:502: 00000040:00080000:0.0:1788837595.696672:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788837595.696681:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788837595.697365:0:8460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788837595.697382:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff889af75899b8) 00000020:00000080:2.0:1788837595.697487:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788837595.697569:0:8460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889afa550800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788837595.697579:0:8460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889afa550800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788837595.697582:0:8460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889afa550800 3 00010000:00080000:2.0:1788837595.697618:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8899c21e0800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.103@tcp at head 00010000:00010000:2.0:1788837595.700767:0:8460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788837595.701297:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788837595.701346:0:8460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788837595.701357:0:8460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x57f6d4e926aeed73 00000100:00080000:2.0:1788837595.701367:0:8460:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837595.701372:0:8460:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8899c21e0800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837595.701474:0:8460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ae7d43100 x1875732036867712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837595.701501:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788837595.701585:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875732036867712:0@lo:38: 00000100:00100000:1.0:1788837595.701652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837595.701747:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036867712 00000100:00100000:2.0:1788837595.701754:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036867712 00000100:00100000:2.0:1788837595.701808:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788837595.701815:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875732036867712:12345-0@lo:38: 00010000:00080000:2.0:1788837595.701836:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:2.0:1788837595.701862:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x57f6d4e926aeed7a 00000004:00100000:2.0:1788837595.701878:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788837595.701910:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837595.701974:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875732036867712:12345-0@lo:38: Request processed in 158us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837595.701982:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788837595.702114:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889ae7d43100 x1875732036867712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837595.702125:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788837595.702133:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788837595.702139:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788837595.702144:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788837595.702146:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c21e0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788837595.702151:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875732036867712:0@lo:38: 00000020:01000004:2.0:1788837595.702642:0:8460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788837595.702656:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff889af7588000) 00000020:00000080:2.0:1788837595.702672:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1788837595.702751:0:8460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889afa550800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788837595.702756:0:8460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889afa550800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788837595.702763:0:8460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889afa550800 3 00010000:00080000:2.0:1788837595.702833:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8899c21e0000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.103@tcp at head 00000100:00100000:3.0:1788837595.705317:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036867840:0@lo:400: 00000100:00100000:3.0:1788837595.705383:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837595.707557:0:8460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1788837595.707759:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788837595.707831:0:8460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788837595.707845:0:8460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x57f6d4e926aeed88 00000100:00080000:2.0:1788837595.707854:0:8460:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837595.707859:0:8460:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8899c21e0000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837595.707890:0:8460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ae7d42300 x1875732036868096/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837595.711512:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837595.711534:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036867968:0@lo:400: 00000100:00100000:3.0:1788837595.711607:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837595.711665:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036867840 00000100:00100000:3.0:1788837595.711673:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036867840 00000100:00100000:3.0:1788837595.711731:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788837595.711741:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036867840:12345-0@lo:400: 00000100:00100000:3.0:1788837595.711822:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036867840:12345-0@lo:400: Request processed in 83us (6438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.711839:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788837595.711879:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036867968 00000100:00100000:3.0:1788837595.711883:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036867968 00000100:00100000:3.0:1788837595.711908:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788837595.711914:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036867968:12345-0@lo:400: 00000100:00100000:3.0:1788837595.711948:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036867968:12345-0@lo:400: Request processed in 35us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.711955:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788837595.712006:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036867968:0@lo:400: 00010000:00080000:3.0:1788837595.712020:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889ae7d45180 x1875732036867840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837595.712031:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036867840:0@lo:400: 00000100:00100000:1.0:1788837595.712284:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875732036868096:0@lo:38: 00000100:00100000:1.0:1788837595.712321:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837595.712357:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036868096 00000100:00100000:1.0:1788837595.712361:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036868096 00000100:00100000:1.0:1788837595.712377:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837595.712382:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875732036868096:12345-0@lo:38: 00010000:00080000:1.0:1788837595.712416:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:1.0:1788837595.712449:0:6525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x57f6d4e926aeed8f 00000004:00100000:1.0:1788837595.712462:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788837595.712492:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8899c1b23000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837595.712533:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875732036868096:12345-0@lo:38: Request processed in 149us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837595.712547:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788837595.712575:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889ae7d42300 x1875732036868096/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837595.712584:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788837595.712591:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788837595.712598:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788837595.712603:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788837595.712605:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c21e0000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788837595.712610:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875732036868096:0@lo:38: 00000100:00100000:1.0:1788837595.712654:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036868224:0@lo:400: 00000100:00100000:1.0:1788837595.712678:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837595.712716:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036868352:0@lo:400: 00000100:00100000:1.0:1788837595.712738:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837595.715505:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036868224 00000100:00100000:3.0:1788837595.715519:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036868224 00000100:00100000:3.0:1788837595.715576:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788837595.715586:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036868224:12345-0@lo:400: 00000100:00100000:3.0:1788837595.715673:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036868224:12345-0@lo:400: Request processed in 88us (2993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.715681:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788837595.715707:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036868352 00000100:00100000:3.0:1788837595.715711:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036868352 00000100:00100000:3.0:1788837595.715734:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788837595.715740:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036868352:12345-0@lo:400: 00000100:00100000:3.0:1788837595.715798:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036868352:12345-0@lo:400: Request processed in 57us (3058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.715804:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788837595.715856:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889ae7d47b80 x1875732036868224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837595.715870:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036868224:0@lo:400: 00000100:00100000:3.0:1788837595.715901:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036868352:0@lo:400: 00000100:00080000:2.0:1788837595.717929:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1788837595.720933:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788837595.723598:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788837595.723640:0:8432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788837595.723667:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeed65 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837595.723681:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeed65 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788837595.723733:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788837595.723736:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788837595.723737:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837595.723738:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837595.723739:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837595.723741:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837595.723742:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788837595.723748:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837595.723750:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837595.723752:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837595.723753:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788837595.723757:0:8432:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788837595.723759:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788837595.723760:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788837595.723761:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837595.723762:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837595.723762:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837595.723763:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837595.723764:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788837595.723765:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837595.723766:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837595.723767:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837595.723767:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788837595.723826:0:8432:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788837595.723846:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036868480:0@lo:253: 00000100:00100000:1.0:1788837595.723916:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837595.723952:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788837595.724086:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036868480 00000100:00100000:3.0:1788837595.724094:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036868480 00000100:00100000:3.0:1788837595.724146:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788837595.724156:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:8432:x1875732036868480:12345-0@lo:253: 20000000:01000000:3.0:1788837595.724342:0:6519:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788837595.724358:0:6519:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788837595.733331:0:6519:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788837595.733386:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788837595.733702:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:8432:x1875732036868480:12345-0@lo:253: Request processed in 9543us (9781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.733716:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788837595.733968:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8432:1875732036868480:0@lo:253: 10000000:01000000:1.0:1788837595.733982:0:8432:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788837595.733985:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788837595.733987:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788837595.733988:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837595.733989:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837595.733991:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837595.733992:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837595.733993:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788837595.733995:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837595.733996:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837595.733998:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837595.734000:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788837595.734027:0:8432:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788837595.735345:0:6540:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788837595.735356:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788837595.735379:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.735927:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889b02044e00/0x57f6d4e926aeec8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeec85 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.735936:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889b02171400/0x57f6d4e926aeeca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeca1 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.735943:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.735998:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889b02171400/0x57f6d4e926aeeca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeeca1 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.736012:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889b02171400/0x57f6d4e926aeeca8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeeca1 expref: 15 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.736106:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875732036868608:0@lo:104: 00000100:00100000:2.0:1788837595.736207:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837595.736304:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889b02044e00/0x57f6d4e926aeec8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeec85 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837595.736313:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889b02044e00/0x57f6d4e926aeec8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeec85 expref: 15 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837595.736322:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d43100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875732036868736:0@lo:104: 00000100:00100000:2.0:1788837595.736342:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac516a240 going to sleep for 11 seconds 00080000:10000000:1.0:1788837595.739755:0:8432:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788837595.739930:0:8432:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00000100:00100000:3.0:1788837595.740192:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788837595.740230:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837595.740263:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036868608 00000100:00100000:3.0:1788837595.740270:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036868608 00000100:00100000:3.0:1788837595.740307:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036868736 00000100:00100000:3.0:1788837595.740310:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036868736 00000100:00100000:3.0:1788837595.740323:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788837595.740332:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b01883850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6540:x1875732036868608:12345-0@lo:104: 00010000:00010000:3.0:1788837595.740348:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7200/0x57f6d4e926aeeca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeca8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.740427:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837595.740441:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b01883850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6540:x1875732036868608:12345-0@lo:104: Request processed in 110us (4234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.740448:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788837595.740488:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837595.740495:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6540:x1875732036868736:12345-0@lo:104: 00010000:00010000:3.0:1788837595.740503:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6c00/0x57f6d4e926aeec85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeec8c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.740540:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788837595.740545:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6540:x1875732036868736:12345-0@lo:104: Request processed in 51us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.740550:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788837595.740586:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837595.740593:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7200/0x57f6d4e926aeeca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeca8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.740600:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac7200 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837595.740605:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7200/0x57f6d4e926aeeca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeeca8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.740613:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7200/0x57f6d4e926aeeca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeeca8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837595.740620:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7200/0x57f6d4e926aeeca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeeca8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837595.740627:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837595.740661:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7200/0x57f6d4e926aeeca1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeca8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.740678:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837595.740702:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7200/0x57f6d4e926aeeca1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeca8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.740708:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ad8ac7200/0x57f6d4e926aeeca1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeca8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.740719:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837595.740722:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6c00/0x57f6d4e926aeec85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeec8c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.740727:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac6c00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837595.740730:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6c00/0x57f6d4e926aeec85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeec8c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.740737:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6c00/0x57f6d4e926aeec85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeec8c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837595.740744:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6c00/0x57f6d4e926aeec85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeec8c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837595.740749:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837595.740762:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6c00/0x57f6d4e926aeec85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec8c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.740767:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837595.740771:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6c00/0x57f6d4e926aeec85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec8c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.740796:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6c00/0x57f6d4e926aeec85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeec8c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.740815:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837595.740817:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837595.740818:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837595.740824:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837595.740846:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036868864:0@lo:103: 00000100:00100000:3.0:1788837595.740878:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837595.740914:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837595.740920:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036868992:0@lo:103: 00000100:00100000:3.0:1788837595.740941:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837595.740995:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036868864 00000100:00100000:3.0:1788837595.741000:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036868864 00010000:00010000:3.0:1788837595.741019:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889b02171400/0x57f6d4e926aeeca8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeca1 expref: 16 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837595.741038:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036868992 00000100:00100000:3.0:1788837595.741053:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036868992 00010000:00010000:3.0:1788837595.741066:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889b02044e00/0x57f6d4e926aeec8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeec85 expref: 17 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837595.741079:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788837595.741086:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:3648:x1875732036868864:12345-0@lo:103: 00010000:00010000:3.0:1788837595.741096:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837595.741101:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889b02171400/0x57f6d4e926aeeca8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeca1 expref: 17 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741111:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889b02171400/0x57f6d4e926aeeca8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeeca1 expref: 17 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741137:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837595.741166:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:3648:x1875732036868864:12345-0@lo:103: Request processed in 81us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.741172:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788837595.741185:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837595.741192:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:3648:x1875732036868992:12345-0@lo:103: 00010000:00010000:3.0:1788837595.741200:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837595.741204:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889b02044e00/0x57f6d4e926aeec8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeec85 expref: 16 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741212:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889b02044e00/0x57f6d4e926aeec8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeec85 expref: 16 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741223:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741230:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788837595.741243:0:6511:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015886511s 00010000:00010000:3.0:1788837595.741247:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741254:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741260:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741266:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741276:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889b02171e00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837595.741280:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741287:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741294:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741303:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837595.741327:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:3648:x1875732036868992:12345-0@lo:103: Request processed in 136us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837595.741333:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837595.741455:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036868992:0@lo:103: 00000100:00100000:3.0:1788837595.741462:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036868864:0@lo:103: 00010000:00010000:3.0:1788837595.741494:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889b02171400/0x57f6d4e926aeeca8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeeca1 expref: 15 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837595.741506:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875732036868608:0@lo:104: 00010000:00010000:3.0:1788837595.741516:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889b02044e00/0x57f6d4e926aeec8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeec85 expref: 14 pid: 6519 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837595.741525:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d43100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875732036868736:0@lo:104: 00010000:00010000:3.0:1788837595.741540:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741559:0:6540:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741565:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837595.741571:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889b02171e00/0x57f6d4e926aeed96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788837595.742221:0:8432:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788837595.742590:0:8432:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788837595.743282:0:8432:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788837595.743618:0:8432:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788837595.745282:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788837595.754756:0:8432:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788837595.754766:0:8432:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788837595.755021:0:8432:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788837595.755076:0:8432:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788837595.755095:0:8432:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788837595.755121:0:8432:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788837595.763569:0:8432:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788837595.763753:0:8432:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788837595.834111:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788837596.828123:0:8516:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788837596.828686:0:8516:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788837596.863590:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788837597.241002:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788837597.241010:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ae7d4b000 from 30 10000000:01000000:3.0:1788837597.241016:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788837597.241057:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837597.241070:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837597.241081:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837597.241103:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036869120:0@lo:101: 00000100:00100000:3.0:1788837597.241181:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837597.241234:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230780 going to sleep for 11 seconds 00000100:00100000:0.0:1788837597.243259:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036869120 00000100:00100000:0.0:1788837597.243272:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036869120 00000100:00100000:0.0:1788837597.243323:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788837597.243332:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:6521:x1875732036869120:12345-0@lo:101: 00010000:00010000:0.0:1788837597.243348:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837597.243364:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac0031400/0x57f6d4e926aeeda4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeed9d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837597.243390:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac0031400/0x57f6d4e926aeeda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeed9d expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837597.243401:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac0031400/0x57f6d4e926aeeda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeed9d expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837597.243410:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0031400, rc 0) 00000100:00100000:0.0:1788837597.243496:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036869120:12345-0@lo:101: Request processed in 165us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837597.243503:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788837597.245034:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036869120:0@lo:101: 00010000:00010000:3.0:1788837597.245060:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeda4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837597.245085:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeda4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837597.245186:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036869248:0@lo:501: 00000100:00100000:3.0:1788837597.245234:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837597.245272:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.245474:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036869248 00000100:00100000:2.0:1788837597.245480:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036869248 00000100:00100000:2.0:1788837597.245524:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788837597.245532:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036869248:12345-0@lo:501: 00000100:00100000:2.0:1788837597.245652:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036869248:12345-0@lo:501: Request processed in 121us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.245659:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788837597.245692:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036869248:0@lo:501: 00000100:00100000:2.0:1788837597.245717:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036869376:0@lo:503: 00000100:00100000:2.0:1788837597.245759:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.245788:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52540 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.245800:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036869376 00000100:00100000:2.0:1788837597.245804:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036869376 00000100:00100000:2.0:1788837597.245825:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788837597.245831:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036869376:12345-0@lo:503: 00000100:00100000:2.0:1788837597.245916:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036869376:12345-0@lo:503: Request processed in 84us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.245923:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788837597.245981:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036869376:0@lo:503: 00000100:00100000:2.0:1788837597.246175:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8535:1875732036869504:0@lo:502: 00000100:00100000:2.0:1788837597.246209:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.246226:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036869504 00000100:00100000:2.0:1788837597.246230:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036869504 00000100:00100000:2.0:1788837597.246249:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788837597.246255:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8535:x1875732036869504:12345-0@lo:502: 00000100:00100000:2.0:1788837597.246325:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8535:x1875732036869504:12345-0@lo:502: Request processed in 69us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.246331:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788837597.246360:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.246371:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8535:1875732036869504:0@lo:502: 00000100:00100000:2.0:1788837597.246408:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8535:1875732036869632:0@lo:502: 00000100:00100000:2.0:1788837597.246438:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.246455:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036869632 00000100:00100000:2.0:1788837597.246458:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036869632 00000100:00100000:2.0:1788837597.246480:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788837597.246493:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8535:x1875732036869632:12345-0@lo:502: 00000100:00100000:2.0:1788837597.246545:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:8535:x1875732036869632:12345-0@lo:502: Request processed in 53us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.246552:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788837597.246578:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.246588:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8535:1875732036869632:0@lo:502: 00000040:00080000:2.0:1788837597.246605:0:8535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788837597.246653:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788837597.246674:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788837597.246682:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeda4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.246692:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeda4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837597.246700:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788837597.246703:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ae7d4b000 from 5 10000000:01000000:2.0:1788837597.246705:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788837597.246727:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.246734:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.246744:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837597.246754:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036869760:0@lo:101: 00000100:00100000:2.0:1788837597.246799:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.246818:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.246828:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036869760 00000100:00100000:2.0:1788837597.246832:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036869760 00000100:00100000:2.0:1788837597.246849:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788837597.246855:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036869760:12345-0@lo:101: 00010000:00010000:2.0:1788837597.246863:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837597.246874:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889b02171400/0x57f6d4e926aeedb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeedab expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.246893:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889b02171400/0x57f6d4e926aeedb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeedab expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.246902:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889b02171400/0x57f6d4e926aeedb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeedab expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.246910:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889b02171400, rc 0) 00000100:00100000:2.0:1788837597.246953:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036869760:12345-0@lo:101: Request processed in 97us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.246959:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788837597.246989:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036869760:0@lo:101: 00010000:00010000:2.0:1788837597.247001:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeedb2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.247009:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeedb2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837597.247050:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036869888:0@lo:256: 00000100:00100000:2.0:1788837597.247079:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.247092:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.247108:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036869888 00000100:00100000:2.0:1788837597.247112:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036869888 00000100:00100000:2.0:1788837597.247131:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788837597.247137:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036869888:12345-0@lo:256: 20000000:01000000:2.0:1788837597.247148:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788837597.247162:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788837597.247165:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788837597.247228:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036869888:12345-0@lo:256: Request processed in 91us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.247235:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788837597.247260:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036869888:0@lo:256: 10000000:01000000:2.0:1788837597.247293:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788837597.247298:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeedb2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.247306:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeedb2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837597.247313:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788837597.247315:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1788837597.247317:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788837597.247341:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.247348:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.247356:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837597.247373:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036870016:0@lo:101: 00000100:00100000:2.0:1788837597.247395:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.247407:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.247417:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036870016 00000100:00100000:2.0:1788837597.247421:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036870016 00000100:00100000:2.0:1788837597.247439:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788837597.247445:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036870016:12345-0@lo:101: 00010000:00010000:2.0:1788837597.247451:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837597.247459:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6dac00/0x57f6d4e926aeedc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeedb9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.247473:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6dac00/0x57f6d4e926aeedc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeedb9 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.247481:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6dac00/0x57f6d4e926aeedc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeedb9 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.247488:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6dac00, rc 0) 00000100:00100000:2.0:1788837597.247515:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036870016:12345-0@lo:101: Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.247521:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788837597.247547:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036870016:0@lo:101: 00010000:00010000:2.0:1788837597.247557:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeedc0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.247565:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeedc0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837597.247612:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036870144:0@lo:501: 00000100:00100000:2.0:1788837597.247635:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.247646:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.247656:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036870144 00000100:00100000:2.0:1788837597.247659:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036870144 00000100:00100000:2.0:1788837597.247677:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788837597.247683:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036870144:12345-0@lo:501: 00000100:00100000:2.0:1788837597.247763:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036870144:12345-0@lo:501: Request processed in 80us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.247770:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788837597.247817:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036870144:0@lo:501: 00000100:00100000:2.0:1788837597.247840:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036870272:0@lo:503: 00000100:00100000:2.0:1788837597.247871:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.247883:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.247892:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036870272 00000100:00100000:2.0:1788837597.247896:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036870272 00000100:00100000:2.0:1788837597.247916:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788837597.247922:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036870272:12345-0@lo:503: 00000100:00100000:2.0:1788837597.248007:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036870272:12345-0@lo:503: Request processed in 85us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.248014:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788837597.248054:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036870272:0@lo:503: 00000100:00100000:2.0:1788837597.248275:0:8536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8536:1875732036870400:0@lo:502: 00000100:00100000:2.0:1788837597.248307:0:8536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.248330:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036870400 00000100:00100000:2.0:1788837597.248334:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036870400 00000100:00100000:2.0:1788837597.248354:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788837597.248360:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:8536:x1875732036870400:12345-0@lo:502: 00000100:00100000:2.0:1788837597.248423:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:8536:x1875732036870400:12345-0@lo:502: Request processed in 63us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.248429:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788837597.250674:0:8536:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac39cda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837597.250717:0:8536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8536:1875732036870400:0@lo:502: 00000020:01000000:3.0:1788837597.250761:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788837597.250769:0:8536:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788837597.250802:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837597.250805:0:8536:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788837597.250811:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788837597.250815:0:8536:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:3.0:1788837597.250855:0:8536:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788837597.250859:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788837597.250888:0:8536:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff889afc3f8000) 00000020:00000080:3.0:1788837597.250913:0:8536:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788837597.250919:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788837597.251024:0:8536:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788837597.251031:0:8536:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788837597.251039:0:8536:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926aeedce 00010000:00080000:3.0:1788837597.251078:0:8536:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889afa551000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788837597.251328:0:8536:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788837597.263137:0:8536:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788837597.263160:0:8536:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788837597.263369:0:8536:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837597.263574:0:8536:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837597.263654:0:8536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788837597.263731:0:8536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788837597.264508:0:8537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837597.264513:0:8537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788837597.265312:0:8536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788837597.265325:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788837597.265363:0:8536:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788837597.265391:0:8536:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926aeedd5 00000100:00080000:2.0:1788837597.265403:0:8536:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837597.265410:0:8536:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff889afa551000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837597.265445:0:8536:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ae7d42d80 x1875732036870528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837597.265526:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732036870528:0@lo:8: 00000100:00100000:0.0:1788837597.265593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788837597.265657:0:8536:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788837597.265824:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837597.265830:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837597.265832:0:8536:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788837597.265835:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837597.265838:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837597.265849:0:8536:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788837597.265859:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788837597.265861:0:8536:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788837597.265887:0:8536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8536:1875732036871424:0@lo:502: 00000100:00100000:2.0:1788837597.265949:0:8536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.265967:0:8536:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788837597.266054:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036870528 00000100:00100000:3.0:1788837597.266061:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036870528 00000100:00100000:3.0:1788837597.266097:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837597.266104:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732036870528:12345-0@lo:8: 00010000:00080000:3.0:1788837597.266146:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:3.0:1788837597.266170:0:8439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926aeeddc 00002000:00100000:3.0:1788837597.266204:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff889affb25800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788837597.266208:0:8439:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1788837597.266212:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788837597.266271:0:8439:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788837597.266488:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788837597.266513:0:8439:0:(import.c:65:import_set_state_nolock()) ffff889affb24800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837597.266986:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036871040:0@lo:400: 00000100:00100000:1.0:1788837597.267024:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.267055:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837597.267062:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036870912:0@lo:400: 00000100:00100000:1.0:1788837597.267085:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.267123:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036870912 00000100:00100000:1.0:1788837597.267129:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036870912 00000100:00100000:1.0:1788837597.267163:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788837597.267170:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036870912:12345-0@lo:400: 00000100:00100000:1.0:1788837597.267208:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036870912:12345-0@lo:400: Request processed in 38us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837597.267215:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788837597.267251:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7d42300 x1875732036870912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837597.267264:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036870912:0@lo:400: 00000100:00100000:1.0:1788837597.269925:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036870784:0@lo:400: 00000100:00100000:2.0:1788837597.270480:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036871040 00000100:00100000:2.0:1788837597.270490:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036871040 00000100:00100000:2.0:1788837597.270537:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788837597.270546:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036871040:12345-0@lo:400: 00000100:00100000:2.0:1788837597.270632:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036871040:12345-0@lo:400: Request processed in 88us (3608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.270639:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788837597.270985:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875732036870528:12345-0@lo:8: Request processed in 4878us (5389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837597.270995:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837597.271309:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036871424 00000100:00100000:3.0:1788837597.271315:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036871424 00000100:00100000:3.0:1788837597.271350:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788837597.271357:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:8536:x1875732036871424:12345-0@lo:502: 00000100:00100000:3.0:1788837597.271487:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:8536:x1875732036871424:12345-0@lo:502: Request processed in 130us (5555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837597.271495:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788837597.271683:0:8536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8536:1875732036871424:0@lo:502: 00000020:01000000:2.0:1788837597.271721:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837597.271729:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837597.271731:0:8536:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788837597.271734:0:8536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1788837597.272130:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1788837597.272151:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788837597.272161:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeedc0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837597.272172:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeedc0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837597.272182:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788837597.272192:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ac3ec4000 from 30 10000000:01000000:3.0:1788837597.272195:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788837597.272224:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837597.272232:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837597.272241:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837597.272260:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036871552:0@lo:101: 00000100:00100000:3.0:1788837597.272299:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837597.272335:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.272431:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036871552 00000100:00100000:2.0:1788837597.272437:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036871552 00000100:00100000:2.0:1788837597.272469:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788837597.272476:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036871552:12345-0@lo:101: 00010000:00010000:2.0:1788837597.272486:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837597.272499:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeedea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeede3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.272520:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeedea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeede3 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.272530:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeedea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeede3 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.272546:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6da600, rc 0) 00000100:00100000:2.0:1788837597.272579:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036871552:12345-0@lo:101: Request processed in 103us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.272585:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788837597.272710:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.272742:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036871296:0@lo:400: 00000100:00100000:1.0:1788837597.272766:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.272805:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788837597.272812:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036870656:0@lo:400: 00000100:00100000:2.0:1788837597.272949:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036870784 00000100:00100000:2.0:1788837597.272954:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036870784 00000100:00100000:2.0:1788837597.272987:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788837597.272994:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036870784:12345-0@lo:400: 00000100:00100000:2.0:1788837597.273030:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036870784:12345-0@lo:400: Request processed in 36us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.273036:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788837597.273077:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.273107:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036871168:0@lo:400: 00000100:00100000:2.0:1788837597.273193:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036871296 00000100:00100000:2.0:1788837597.273197:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036871296 00000100:00100000:2.0:1788837597.273233:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036870656 00000100:00100000:2.0:1788837597.273236:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036870656 00000100:00100000:2.0:1788837597.273249:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788837597.273255:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036871296:12345-0@lo:400: 00000100:00100000:2.0:1788837597.273288:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036871296:12345-0@lo:400: Request processed in 33us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.273294:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788837597.273305:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837597.273310:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036870656:12345-0@lo:400: 00000100:00100000:2.0:1788837597.273336:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036870656:12345-0@lo:400: Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.273342:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788837597.273410:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.273444:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036870784:0@lo:400: 00010000:00080000:1.0:1788837597.273457:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa736300 x1875732036871296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837597.273466:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036871296:0@lo:400: 00010000:00080000:1.0:1788837597.273485:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7d41c00 x1875732036870656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837597.273492:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036870656:0@lo:400: 00000100:00100000:1.0:1788837597.273522:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036871040:0@lo:400: 00000100:00080000:1.0:1788837597.273541:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837597.273719:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036871168 00000100:00100000:2.0:1788837597.273730:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036871168 00000100:00100000:2.0:1788837597.273768:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837597.273800:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036871168:12345-0@lo:400: 00000100:00100000:2.0:1788837597.273839:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036871168:12345-0@lo:400: Request processed in 64us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.273855:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788837597.273889:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7d41180 x1875732036871168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837597.273898:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036871168:0@lo:400: 00000100:00080000:1.0:1788837597.274044:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837597.274121:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036871552:0@lo:101: 00010000:00010000:3.0:1788837597.274140:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeedea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837597.274149:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeedea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837597.274216:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036871680:0@lo:501: 00000100:00100000:3.0:1788837597.274252:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837597.274287:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.275022:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036871680 00000100:00100000:2.0:1788837597.275030:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036871680 00000100:00100000:2.0:1788837597.275065:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788837597.275073:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036871680:12345-0@lo:501: 00000100:00100000:2.0:1788837597.275218:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036871680:12345-0@lo:501: Request processed in 145us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.275225:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788837597.275552:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036871680:0@lo:501: 00000100:00100000:3.0:1788837597.275588:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036871808:0@lo:503: 00000100:00100000:3.0:1788837597.275633:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837597.275655:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837597.275673:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036871808 00000100:00100000:3.0:1788837597.275677:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036871808 00000100:00100000:3.0:1788837597.275703:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788837597.275709:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036871808:12345-0@lo:503: 00000100:00100000:3.0:1788837597.275810:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036871808:12345-0@lo:503: Request processed in 99us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837597.275816:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788837597.276516:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036871808:0@lo:503: 00010000:00080000:0.0:1788837597.276662:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7d42d80 x1875732036870528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788837607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837597.276673:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837597.276680:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788837597.276687:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788837597.276692:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788837597.276696:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889afa551000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788837597.276711:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788837597.276717:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732036870528:0@lo:8: 00000100:00100000:0.0:1788837597.276992:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8538:1875732036871936:0@lo:700: 00000100:00100000:0.0:1788837597.277030:0:8538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837597.277050:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adeb73c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837597.277188:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036871936 00000100:00100000:1.0:1788837597.277194:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036871936 00000100:00100000:1.0:1788837597.277249:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837597.277256:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8538:x1875732036871936:12345-0@lo:700: 00000100:00100000:1.0:1788837597.277287:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8447:1875732036872064:0@lo:700: 00000100:00100000:1.0:1788837597.277315:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.277331:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f35780 going to sleep for 11 seconds 00000004:00080000:1.0:1788837597.277407:0:8537:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788837597.277490:0:8537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 214148712656ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788837597.277495:0:8537:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788837597.277529:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036872064 00000100:00100000:1.0:1788837597.277533:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036872064 00000100:00100000:1.0:1788837597.277557:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837597.277562:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8447:x1875732036872064:12345-0@lo:700: 00000100:00080000:0.0:1788837597.277810:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837597.279324:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8539:1875732036872192:0@lo:502: 00000100:00100000:0.0:1788837597.279428:0:8539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.279522:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036872192 00000100:00100000:2.0:1788837597.279531:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036872192 00000100:00100000:2.0:1788837597.279570:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788837597.279579:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:8539:x1875732036872192:12345-0@lo:502: 00000100:00100000:2.0:1788837597.279690:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:8539:x1875732036872192:12345-0@lo:502: Request processed in 111us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.279697:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788837597.279819:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f40b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837597.279838:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8539:1875732036872192:0@lo:502: 00000004:00080000:2.0:1788837597.279981:0:7456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788837597.280072:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8539:1875732036872320:0@lo:502: 00000100:00100000:0.0:1788837597.280105:0:8539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837597.280310:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f40b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.282965:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036872320 00000100:00100000:2.0:1788837597.282976:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036872320 00000100:00100000:2.0:1788837597.283026:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788837597.283047:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:8539:x1875732036872320:12345-0@lo:502: 00000100:00100000:2.0:1788837597.283270:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:8539:x1875732036872320:12345-0@lo:502: Request processed in 223us (3163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.283277:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788837597.283462:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8539:1875732036872320:0@lo:502: 00000040:00080000:0.0:1788837597.283507:0:8539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788837597.290985:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788837597.291034:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788837597.291047:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeedea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.291062:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeedea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 40000000:02000000:3.0:1788837597.291073:0:6531:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 10000000:01000000:2.0:1788837597.291073:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788837597.291078:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ac3ec4000 from 5 10000000:01000000:2.0:1788837597.291082:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788837597.292960:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.292977:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.292991:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837597.293017:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036872448:0@lo:101: 00000100:00100000:2.0:1788837597.293087:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.293249:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036872448 00000100:00100000:2.0:1788837597.293257:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036872448 00000100:00100000:2.0:1788837597.293304:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788837597.293313:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036872448:12345-0@lo:101: 00010000:00010000:2.0:1788837597.293333:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837597.293347:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6da000/0x57f6d4e926aeedf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeedf1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.293372:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6da000/0x57f6d4e926aeedf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeedf1 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.293383:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6da000/0x57f6d4e926aeedf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeedf1 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.293391:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6da000, rc 0) 00000100:00100000:2.0:1788837597.293428:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:6521:x1875732036872448:12345-0@lo:101: Request processed in 116us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.293433:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788837597.293478:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.293500:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036872448:0@lo:101: 00010000:00010000:2.0:1788837597.293514:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeedf8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.293523:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeedf8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837597.293573:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036872576:0@lo:256: 00000100:00100000:2.0:1788837597.293604:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.293622:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.293835:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036872576 00000100:00100000:2.0:1788837597.293846:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036872576 00000100:00100000:2.0:1788837597.293872:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788837597.293878:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:6521:x1875732036872576:12345-0@lo:256: 20000000:01000000:2.0:1788837597.293897:0:6519:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788837597.293911:0:6519:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788837597.293913:0:6519:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788837597.294104:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:6521:x1875732036872576:12345-0@lo:256: Request processed in 225us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.294111:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788837597.294220:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036872576:0@lo:256: 10000000:01000000:2.0:1788837597.294264:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788837597.294270:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeedf8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.294279:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeedf8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837597.294287:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788837597.294289:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788837597.294292:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788837597.294310:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.294316:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.294323:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837597.294334:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036872704:0@lo:101: 00000100:00100000:2.0:1788837597.294360:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.294380:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036872704 00000100:00100000:2.0:1788837597.294391:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036872704 00000100:00100000:2.0:1788837597.294415:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788837597.294421:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:6521:x1875732036872704:12345-0@lo:101: 00010000:00010000:2.0:1788837597.294428:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837597.294438:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926aeee06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeedff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.294453:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926aeee06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeedff expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.294462:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926aeee06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeedff expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.294470:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6dbc00, rc 0) 00000100:00100000:2.0:1788837597.294493:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036872704:12345-0@lo:101: Request processed in 72us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.294498:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788837597.294516:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.294525:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036872704:0@lo:101: 00010000:00010000:2.0:1788837597.294534:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.294541:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeee06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837597.294583:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036872832:0@lo:501: 00000100:00100000:2.0:1788837597.294602:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.294616:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036872832 00000100:00100000:2.0:1788837597.294618:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036872832 00000100:00100000:2.0:1788837597.294640:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788837597.294644:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036872832:12345-0@lo:501: 00000100:00100000:2.0:1788837597.294735:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036872832:12345-0@lo:501: Request processed in 89us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.294741:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788837597.294762:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.294794:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036872832:0@lo:501: 00000100:00100000:2.0:1788837597.294819:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036872960:0@lo:503: 00000100:00100000:2.0:1788837597.295047:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.295066:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036872960 00000100:00100000:2.0:1788837597.295069:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036872960 00000100:00100000:2.0:1788837597.295089:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788837597.295095:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036872960:12345-0@lo:503: 00000100:00100000:2.0:1788837597.296109:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036872960:12345-0@lo:503: Request processed in 1008us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.296188:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788837597.296239:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52540 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.296259:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036872960:0@lo:503: 00000100:00100000:2.0:1788837597.296491:0:8541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8541:1875732036873088:0@lo:502: 00000100:00100000:2.0:1788837597.296531:0:8541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.296554:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036873088 00000100:00100000:2.0:1788837597.296558:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036873088 00000100:00100000:2.0:1788837597.296586:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788837597.296593:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:8541:x1875732036873088:12345-0@lo:502: 00000100:00100000:2.0:1788837597.296676:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:8541:x1875732036873088:12345-0@lo:502: Request processed in 82us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.296690:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788837597.296720:0:8541:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.296733:0:8541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8541:1875732036873088:0@lo:502: 00000020:01000000:2.0:1788837597.296754:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788837597.296762:0:8541:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788837597.296768:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837597.296770:0:8541:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788837597.296796:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788837597.296800:0:8541:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:2.0:1788837597.296823:0:8541:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788837597.296826:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:3.0:1788837597.297491:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8447:x1875732036872064:12345-0@lo:700: Request processed in 19797us (20043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837597.297504:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788837597.297555:0:8447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7d42d80 x1875732036872064/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788837613 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837597.297568:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8447:1875732036872064:0@lo:700: 40000000:02000000:3.0:1788837597.297578:0:8447:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000020:00000080:2.0:1788837597.298110:0:8541:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff889af758cd28) 00000020:00000080:2.0:1788837597.298217:0:8541:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788837597.298228:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788837597.298324:0:8541:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788837597.298330:0:8541:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788837597.298337:0:8541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926aeee14 00010000:00080000:2.0:1788837597.298372:0:8541:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889affb4b000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:2.0:1788837597.298623:0:8541:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:2.0:1788837597.307528:0:8541:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788837597.307554:0:8541:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788837597.307739:0:8541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837597.308356:0:8541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837597.308521:0:8541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788837597.308618:0:8541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788837597.309127:0:8542:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837597.309132:0:8542:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000001:00100000:0.0:1788837597.311793:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788837597.312271:0:8541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788837597.312285:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788837597.312329:0:8541:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788837597.312353:0:8541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926aeee1b 00000100:00080000:2.0:1788837597.312436:0:8541:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837597.312441:0:8541:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff889affb4b000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837597.312479:0:8541:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afa735c00 x1875732036873216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837597.312534:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732036873216:0@lo:8: 00000100:00100000:0.0:1788837597.312602:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.312693:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036873216 00000100:00100000:1.0:1788837597.312700:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036873216 00000100:00100000:1.0:1788837597.312737:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837597.312743:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875732036873216:12345-0@lo:8: 00010000:00080000:1.0:1788837597.312766:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1788837597.312813:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926aeee22 00002000:00100000:1.0:1788837597.312827:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8899c1b21000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788837597.312832:0:8441:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788837597.312834:0:8441:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788837597.312914:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788837597.312946:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8899c1b24000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788837597.313028:0:8541:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788837597.313093:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837597.313099:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837597.313102:0:8541:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788837597.313106:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837597.313110:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:3.0:1788837597.313115:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8538:x1875732036871936:12345-0@lo:700: Request processed in 35857us (36082us total) trans 0 rc 0/0 00000020:00000080:2.0:1788837597.313123:0:8541:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788837597.313129:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788837597.313131:0:8541:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788837597.313143:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837597.313164:0:8541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8541:1875732036873344:0@lo:502: 00000100:00100000:2.0:1788837597.313209:0:8541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.313243:0:8541:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac2b95240 going to sleep for 11 seconds 00000100:00100000:3.0:1788837597.313345:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036873344 00000100:00100000:3.0:1788837597.313350:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036873344 00000100:00100000:3.0:1788837597.313388:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788837597.313395:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:8541:x1875732036873344:12345-0@lo:502: 00000100:00100000:1.0:1788837597.313586:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875732036873216:12345-0@lo:8: Request processed in 840us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837597.313594:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837597.313641:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:8541:x1875732036873344:12345-0@lo:502: Request processed in 245us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837597.313653:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788837597.313683:0:8541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:8541:1875732036873344:0@lo:502: 00000020:01000000:2.0:1788837597.313711:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837597.313715:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837597.313717:0:8541:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788837597.313720:0:8541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788837597.313956:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788837597.313977:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788837597.313986:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837597.313996:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837597.314005:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788837597.314008:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff889ac85799b8 from 1 10000000:01000000:3.0:1788837597.314011:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788837597.314034:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837597.314043:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837597.314052:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837597.314064:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036873472:0@lo:101: 00000100:00100000:3.0:1788837597.314108:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837597.314562:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230000 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.314613:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036873472 00000100:00100000:2.0:1788837597.314618:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036873472 00000100:00100000:2.0:1788837597.314659:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788837597.314667:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036873472:12345-0@lo:101: 00010000:00010000:2.0:1788837597.314677:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837597.314690:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6daa00/0x57f6d4e926aeee30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeee29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.314726:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6daa00/0x57f6d4e926aeee30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeee29 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.314737:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6daa00/0x57f6d4e926aeee30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeee29 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837597.314745:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6daa00, rc 0) 00000100:00100000:2.0:1788837597.314811:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036873472:12345-0@lo:101: Request processed in 144us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.314818:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:0.0:1788837597.315000:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa735c00 x1875732036873216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788837607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837597.315010:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837597.315017:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788837597.315024:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788837597.315028:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788837597.315031:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889affb4b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788837597.315132:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036873472:0@lo:101: 00010000:00010000:1.0:1788837597.315157:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837597.315167:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeee30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837597.315226:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036873600:0@lo:501: 00000100:00100000:1.0:1788837597.315256:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.315289:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f35780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837597.315517:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036873600 00000100:00100000:3.0:1788837597.315522:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036873600 00000100:00100000:3.0:1788837597.315564:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788837597.315573:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036873600:12345-0@lo:501: 00000100:00100000:3.0:1788837597.315653:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036873600:12345-0@lo:501: Request processed in 81us (396us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788837597.315660:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788837597.315703:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036873600:0@lo:501: 10000000:01000000:3.0:1788837597.315733:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788837597.315740:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837597.315749:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788837597.315826:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788837597.315834:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732036873216:0@lo:8: 00010000:00080000:0.0:1788837597.315888:0:8538:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ac85eb100 x1875732036871936/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788837613 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837597.315899:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8538:1875732036871936:0@lo:700: 00000004:00080000:3.0:1788837597.316133:0:8542:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788837597.316197:0:8542:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 214187419772ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788837597.316204:0:8542:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788837597.318464:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788837597.324744:0:8543:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788837597.324796:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d43100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8543:1875732036873856:0@lo:7: 00000100:00100000:0.0:1788837597.324944:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036873728:0@lo:13: 00000100:00100000:0.0:1788837597.324996:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837597.325101:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036873728 00000100:00100000:2.0:1788837597.325109:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036873728 00000100:00100000:2.0:1788837597.325187:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837597.325196:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036873728:12345-0@lo:13: 00002000:00000024:2.0:1788837597.325223:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788837597.325270:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036873728:12345-0@lo:13: Request processed in 75us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.325277:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788837597.325317:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7d41c00 x1875732036873728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837597.325334:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036873728:0@lo:13: 00000100:00080000:0.0:1788837597.325479:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837597.325578:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.325606:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f35cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.326039:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036873856 00000100:00100000:2.0:1788837597.326045:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036873856 00000100:00100000:2.0:1788837597.326082:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837597.326090:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8543:x1875732036873856:12345-0@lo:7: 00000004:00080000:1.0:1788837597.329028:0:8538:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788837597.329059:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d40a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8538:1875732036874112:0@lo:7: 00000100:00100000:1.0:1788837597.329130:0:8538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.329182:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f35780 going to sleep for 11 seconds 00000100:00100000:1.0:1788837597.329203:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788837597.329210:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788837597.329346:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036873984:0@lo:13: 00000100:00100000:3.0:1788837597.329394:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.329994:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036873984 00000100:00100000:1.0:1788837597.330002:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036873984 00000100:00100000:1.0:1788837597.330041:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837597.330049:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036873984:12345-0@lo:13: 00002000:00000024:1.0:1788837597.330068:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1788837597.330120:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036873984:12345-0@lo:13: Request processed in 60us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837597.330127:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788837597.330326:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7d41c00 x1875732036873984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837597.330345:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036873984:0@lo:13: 00002000:00080000:2.0:1788837597.332759:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788837597.332835:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788837597.333062:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8543:x1875732036873856:12345-0@lo:7: Request processed in 6969us (7480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.333072:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837597.333098:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036874112 00000100:00100000:2.0:1788837597.333105:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036874112 00000100:00100000:2.0:1788837597.333467:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788837597.333477:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8538:x1875732036874112:12345-0@lo:7: 00010000:00080000:1.0:1788837597.334014:0:8543:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7d43100 x1875732036873856/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788837613 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837597.334030:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d43100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8543:1875732036873856:0@lo:7: 00000004:00080000:1.0:1788837597.334042:0:8543:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788837597.334078:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d43100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8543:1875732036874240:0@lo:5: 00000100:00100000:1.0:1788837597.334131:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.334171:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036874240 00000100:00100000:1.0:1788837597.334175:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036874240 00000100:00100000:1.0:1788837597.334208:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837597.334214:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8543:x1875732036874240:12345-0@lo:5: 00002000:00080000:1.0:1788837597.334235:0:8441:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788837597.334238:0:8441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788837597.334265:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f35cc0 going to sleep for 11 seconds 00002000:00080000:2.0:1788837597.344341:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788837597.344350:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788837597.344456:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8538:x1875732036874112:12345-0@lo:7: Request processed in 10976us (15322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.344466:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788837597.346069:0:8538:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7d40a80 x1875732036874112/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788837613 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837597.346087:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d40a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8538:1875732036874112:0@lo:7: 00000004:00080000:1.0:1788837597.346100:0:8538:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788837597.346158:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d40a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8538:1875732036874368:0@lo:5: 00000100:00100000:1.0:1788837597.346208:0:8538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.346256:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f35780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.346358:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036874368 00000100:00100000:2.0:1788837597.346376:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036874368 00000100:00100000:2.0:1788837597.346423:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837597.346432:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8538:x1875732036874368:12345-0@lo:5: 00002000:00080000:2.0:1788837597.346456:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788837597.346493:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8538:x1875732036874368:12345-0@lo:5: Request processed in 62us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837597.346499:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788837597.346880:0:8538:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7d40a80 x1875732036874368/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837613 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837597.346891:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d40a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8538:1875732036874368:0@lo:5: 00000004:00080000:1.0:1788837597.346899:0:8538:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788837597.346923:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5edf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8538:1875732036874496:0@lo:5: 00000100:00100000:1.0:1788837597.346961:0:8538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.346984:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f35780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837597.347077:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036874496 00000100:00100000:2.0:1788837597.347082:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036874496 00000100:00100000:2.0:1788837597.347118:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837597.347125:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8538:x1875732036874496:12345-0@lo:5: 00002000:00080000:2.0:1788837597.347176:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788837597.362095:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8538:x1875732036874496:12345-0@lo:5: Request processed in 14962us (15126us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788837597.362108:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788837597.362423:0:8538:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa5edf80 x1875732036874496/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837613 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837597.362440:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5edf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8538:1875732036874496:0@lo:5: 00000004:00080000:3.0:1788837597.362456:0:8538:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788837597.362501:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8538:1875732036874624:0@lo:900: 00000100:00100000:3.0:1788837597.362537:0:8538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837597.362561:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7e993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837597.362590:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036874624 00000100:00100000:3.0:1788837597.362596:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036874624 00000100:00100000:3.0:1788837597.362648:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837597.362667:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8538:x1875732036874624:12345-0@lo:900: 00000100:00100000:3.0:1788837597.362716:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8538:x1875732036874624:12345-0@lo:900: Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837597.362722:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788837597.362748:0:8538:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7e3df80 x1875732036874624/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788837613 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837597.362757:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8538:1875732036874624:0@lo:900: 00000001:00080000:1.0:1788837597.363294:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788837597.363307:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788837597.363444:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8543:x1875732036874240:12345-0@lo:5: Request processed in 29228us (29311us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788837597.363450:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788837597.363576:0:8543:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7d43100 x1875732036874240/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837613 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837597.363586:0:8543:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788837597.363591:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d43100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8543:1875732036874240:0@lo:5: 00000004:00080000:1.0:1788837597.363610:0:8543:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788837597.363643:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8543:1875732036874752:0@lo:700: 00000100:00100000:1.0:1788837597.363676:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.363706:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036874752 00000100:00100000:1.0:1788837597.363710:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036874752 00000100:00100000:1.0:1788837597.363746:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837597.363754:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8543:x1875732036874752:12345-0@lo:700: 00000100:00100000:1.0:1788837597.363898:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f35cc0 going to sleep for 11 seconds 00000001:00080000:2.0:1788837597.375617:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1788837597.375823:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8543:x1875732036874752:12345-0@lo:700: Request processed in 12063us (12139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837597.375838:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788837597.376260:0:8543:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa5ef100 x1875732036874752/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788837613 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837597.376275:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8543:1875732036874752:0@lo:700: 00000004:02000040:1.0:1788837597.379198:0:8543:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1788837597.384249:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8543:1875732036874880:0@lo:5: 00000100:00100000:1.0:1788837597.384336:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837597.384391:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036874880 00000100:00100000:1.0:1788837597.384398:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036874880 00000100:00100000:1.0:1788837597.384448:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788837597.384457:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8543:x1875732036874880:12345-0@lo:5: 00000100:00100000:2.0:1788837597.391317:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f35cc0 going to sleep for 11 seconds 00002000:00080000:1.0:1788837597.392563:0:8544:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788837597.392583:0:8544:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788837597.400946:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8543:x1875732036874880:12345-0@lo:5: Request processed in 16473us (16594us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788837597.400959:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788837597.401072:0:8543:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa5ee680 x1875732036874880/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837613 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837597.401089:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8543:1875732036874880:0@lo:5: 00000004:00080000:3.0:1788837597.401104:0:8543:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1788837597.881039:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837598.909340:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837599.164368:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837599.164394:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036875008:0@lo:41: 00000100:00100000:0.0:1788837599.164461:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837599.164533:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036875008 00000100:00100000:0.0:1788837599.164540:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036875008 00000100:00100000:0.0:1788837599.164589:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788837599.164607:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036875008:12345-0@lo:41: 00000004:00000024:0.0:1788837599.164639:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788837599.164685:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036875008:12345-0@lo:41: Request processed in 80us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837599.164693:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788837599.164741:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036875008:0@lo:41: 00010000:00010000:1.0:1788837599.932300:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837600.186214:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837600.186239:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036875136:0@lo:41: 00000100:00100000:3.0:1788837600.186325:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837600.186366:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036875136 00000100:00100000:0.0:1788837600.186375:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036875136 00000100:00100000:0.0:1788837600.186484:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788837600.186494:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036875136:12345-0@lo:41: 00000004:00000024:0.0:1788837600.186527:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788837600.186574:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036875136:12345-0@lo:41: Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837600.186581:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788837600.186644:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036875136:0@lo:41: 00010000:00010000:3.0:1788837600.956025:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837601.980671:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837602.745567:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036875264:0@lo:13: 00000100:00100000:3.0:1788837602.745632:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837602.745817:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036875264 00000100:00100000:3.0:1788837602.745826:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036875264 00000100:00100000:3.0:1788837602.745897:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837602.745909:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036875264:12345-0@lo:13: 00002000:00000024:3.0:1788837602.746015:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837602.746061:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036875264:12345-0@lo:13: Request processed in 155us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837602.746068:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788837602.746090:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837602.746116:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c25b5880 x1875732036875264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837602.746126:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788837602.746148:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036875264:0@lo:13: 00000100:00100000:0.0:1788837602.747766:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036875392:0@lo:400: 00000100:00100000:0.0:1788837602.747851:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837602.747889:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036875904:0@lo:400: 00000100:00100000:0.0:1788837602.747915:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837602.748441:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036875648:0@lo:400: 00000100:00100000:3.0:1788837602.753904:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036875904 00000100:00100000:3.0:1788837602.754500:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036875904 00000100:00100000:3.0:1788837602.754574:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837602.754584:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036875904:12345-0@lo:400: 00000100:00100000:1.0:1788837602.755758:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837602.755821:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036876160:0@lo:400: 00000100:00100000:1.0:1788837602.755871:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837602.755897:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788837602.755903:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036875520:0@lo:400: 00000100:00100000:1.0:1788837602.755922:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837602.755948:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036876032:0@lo:400: 00000100:00100000:1.0:1788837602.755968:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837602.756001:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036875776:0@lo:400: 00000100:00100000:1.0:1788837602.756023:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837602.756034:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036876288:0@lo:400: 00000100:00100000:1.0:1788837602.756055:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837602.756101:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036876160 00000100:00100000:1.0:1788837602.756108:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036876160 00000100:00100000:1.0:1788837602.756147:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036875520 00000100:00100000:1.0:1788837602.756150:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036875520 00000100:00100000:1.0:1788837602.756161:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036876032 00000100:00100000:1.0:1788837602.756163:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036876032 00000100:00100000:1.0:1788837602.756173:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036875776 00000100:00100000:1.0:1788837602.756176:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036875776 00000100:00100000:1.0:1788837602.756189:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837602.756206:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036876160:12345-0@lo:400: 00000100:00100000:1.0:1788837602.756253:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036876160:12345-0@lo:400: Request processed in 56us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837602.756260:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837602.756278:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837602.756283:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036875520:12345-0@lo:400: 00000100:00100000:1.0:1788837602.756872:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036875520:12345-0@lo:400: Request processed in 587us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837602.756879:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837602.756896:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788837602.756903:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036876032:12345-0@lo:400: 00000100:00100000:1.0:1788837602.756940:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036876032:12345-0@lo:400: Request processed in 39us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837602.756947:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788837602.756958:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788837602.756963:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036875776:12345-0@lo:400: 00000100:00100000:1.0:1788837602.756996:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036875776:12345-0@lo:400: Request processed in 32us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837602.757002:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788837602.757025:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837602.757029:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788837602.757056:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ac85eb480 x1875732036875520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837602.757071:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036875520:0@lo:400: 00010000:00080000:1.0:1788837602.757082:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c2651180 x1875732036876032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837602.757090:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036876032:0@lo:400: 00010000:00080000:1.0:1788837602.757112:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c2653800 x1875732036876160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837602.757120:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036876160:0@lo:400: 00010000:00080000:1.0:1788837602.757166:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ac85e9180 x1875732036875776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837602.757176:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036875776:0@lo:400: 00000100:00100000:1.0:1788837602.757217:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036875648 00000100:00100000:1.0:1788837602.757222:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036875648 00000100:00100000:1.0:1788837602.757245:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788837602.757252:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036875648:12345-0@lo:400: 00000100:00100000:1.0:1788837602.757289:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036875648:12345-0@lo:400: Request processed in 38us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837602.758040:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788837602.758090:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036875648:0@lo:400: 00000100:00100000:1.0:1788837602.758141:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036875392 00000100:00100000:1.0:1788837602.758146:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036875392 00000100:00100000:1.0:1788837602.758179:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788837602.758185:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:3649:x1875732036875392:12345-0@lo:400: 00000100:00100000:1.0:1788837602.758251:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:3649:x1875732036875392:12345-0@lo:400: Request processed in 66us (10400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837602.758256:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788837602.758481:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036876288 00000100:00100000:2.0:1788837602.758485:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036876288 00000100:00100000:2.0:1788837602.758536:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788837602.758544:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036876288:12345-0@lo:400: 00000100:00100000:2.0:1788837602.758642:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036876288:12345-0@lo:400: Request processed in 99us (2586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837602.758649:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788837602.758756:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c2653100 x1875732036876288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837602.758768:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036876288:0@lo:400: 00000100:00080000:1.0:1788837602.760398:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837602.760425:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036876416:0@lo:13: 00000100:00100000:1.0:1788837602.760482:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837602.760531:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036875392:0@lo:400: 00000100:00100000:1.0:1788837602.760562:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036876416 00000100:00100000:1.0:1788837602.760567:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036876416 00000100:00100000:1.0:1788837602.760605:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837602.760613:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875732036876416:12345-0@lo:13: 00002000:00000024:1.0:1788837602.760643:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837602.760805:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875732036876416:12345-0@lo:13: Request processed in 193us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837602.760813:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788837602.760934:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c25b5880 x1875732036876416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837602.760953:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036876416:0@lo:13: 00000100:00100000:0.0:1788837602.767160:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036875904:12345-0@lo:400: Request processed in 12566us (19232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837602.767175:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788837602.767428:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036875904:0@lo:400: 00000001:02000400:2.0:1788837602.769172:0:8814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788837603.001252:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788837603.265499:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000020:00000004:0.0:1788837603.911179:0:8867:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788837603.911384:0:8867:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788837604.024928:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837604.281009:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036876544:0@lo:41: 00000100:00100000:1.0:1788837604.281146:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837604.284341:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036876544 00000100:00100000:2.0:1788837604.284356:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036876544 00000100:00100000:2.0:1788837604.284424:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788837604.284434:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036876544:12345-0@lo:41: 00000004:00000024:2.0:1788837604.284471:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788837604.287763:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036876544:12345-0@lo:41: Request processed in 3322us (6609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837604.287794:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788837604.289527:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036876544:0@lo:41: 00010000:00010000:1.0:1788837605.050385:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837605.305113:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036876672:0@lo:41: 00000100:00100000:0.0:1788837605.305194:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837605.306373:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036876672 00000100:00100000:1.0:1788837605.306387:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036876672 00000100:00100000:1.0:1788837605.306492:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788837605.306503:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036876672:12345-0@lo:41: 00000004:00000024:1.0:1788837605.306541:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788837605.306621:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036876672:12345-0@lo:41: Request processed in 121us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837605.306629:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788837605.306717:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036876672:0@lo:41: 00010000:00010000:1.0:1788837606.073044:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788837606.561437:0:8968:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788837606.561759:0:8968:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788837607.098608:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788837607.522682:0:9017:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788837607.522693:0:9017:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1788837607.865691:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036876800:0@lo:400: 00000100:00100000:2.0:1788837607.865812:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837607.865868:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036877312:0@lo:400: 00000100:00100000:2.0:1788837607.865897:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837607.865916:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036877824:0@lo:400: 00000100:00100000:2.0:1788837607.865937:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837607.865962:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788837607.865968:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036876928:0@lo:400: 00000100:00100000:2.0:1788837607.865991:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837607.866006:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036877440:0@lo:400: 00000100:00100000:2.0:1788837607.866038:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837607.866067:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036877056:0@lo:400: 00000100:00100000:2.0:1788837607.866090:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837607.866409:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837607.866418:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036877952:0@lo:13: 00000100:00100000:3.0:1788837607.866446:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837607.866475:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036877952 00000100:00100000:3.0:1788837607.866482:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036877952 00000100:00100000:3.0:1788837607.866539:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837607.866549:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036877952:12345-0@lo:13: 00002000:00000024:3.0:1788837607.866579:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837607.866625:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036877952:12345-0@lo:13: Request processed in 78us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837607.866632:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788837607.866652:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837607.866682:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c25b6d80 x1875732036877952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837607.866711:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788837607.866734:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036877952:0@lo:13: 00000100:00100000:3.0:1788837607.866798:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036877312 00000100:00100000:3.0:1788837607.866803:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036877312 00000100:00100000:3.0:1788837607.866829:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036877056 00000100:00100000:3.0:1788837607.866832:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036877056 00000100:00100000:3.0:1788837607.866846:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788837607.866852:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036877312:12345-0@lo:400: 00000100:00100000:3.0:1788837607.866894:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036877312:12345-0@lo:400: Request processed in 42us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837607.866902:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788837607.866914:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788837607.866919:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036877056:12345-0@lo:400: 00000100:00100000:3.0:1788837607.866947:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036877056:12345-0@lo:400: Request processed in 28us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837607.866966:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788837607.866986:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732036877184:0@lo:400: 00000100:00100000:3.0:1788837607.867014:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837607.867033:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036877696:0@lo:400: 00000100:00100000:3.0:1788837607.867053:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837607.867069:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837607.867075:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036878080:0@lo:13: 00000100:00100000:3.0:1788837607.867094:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837607.867804:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036878080 00000100:00100000:0.0:1788837607.867811:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036878080 00000100:00100000:0.0:1788837607.867867:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788837607.867876:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036878080:12345-0@lo:13: 00002000:00000024:0.0:1788837607.867890:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837607.867936:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036878080:12345-0@lo:13: Request processed in 63us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837607.867942:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788837607.867959:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837607.867989:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036877312:0@lo:400: 00010000:00080000:0.0:1788837607.868041:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c25b4000 x1875732036878080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837607.868054:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036878080:0@lo:13: 00000100:00100000:0.0:1788837607.868084:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036877824 00000100:00100000:0.0:1788837607.868087:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036877824 00000100:00100000:0.0:1788837607.868125:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036877696 00000100:00100000:0.0:1788837607.868128:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036877696 00000100:00100000:1.0:1788837607.868247:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036876800 00000100:00100000:1.0:1788837607.868252:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036876800 00000100:00100000:1.0:1788837607.868283:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788837607.868290:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:3648:x1875732036876800:12345-0@lo:400: 00000100:00100000:1.0:1788837607.868332:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:3648:x1875732036876800:12345-0@lo:400: Request processed in 44us (2521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837607.868350:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788837607.868380:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036876928 00000100:00100000:1.0:1788837607.868385:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036876928 00000100:00100000:1.0:1788837607.868403:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036877440 00000100:00100000:1.0:1788837607.868406:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036877440 00000100:00100000:1.0:1788837607.868427:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036877184 00000100:00100000:1.0:1788837607.868430:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036877184 00000100:00100000:1.0:1788837607.868444:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788837607.868450:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036876928:12345-0@lo:400: 00000100:00100000:1.0:1788837607.869332:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036876928:12345-0@lo:400: Request processed in 876us (3334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837607.869340:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788837607.869362:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788837607.869371:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036877440:12345-0@lo:400: 00000100:00100000:1.0:1788837607.869410:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036877440:12345-0@lo:400: Request processed in 42us (3383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837607.869415:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788837607.869427:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788837607.869433:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732036877184:12345-0@lo:400: 00000100:00100000:1.0:1788837607.869469:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732036877184:12345-0@lo:400: Request processed in 36us (2454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837607.869475:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788837607.869503:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788837607.869511:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036877824:12345-0@lo:400: 00000100:00100000:1.0:1788837607.869542:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036877824:12345-0@lo:400: Request processed in 32us (3603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837607.869561:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788837607.869583:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788837607.869645:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa737480 x1875732036877184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837607.869658:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732036877184:0@lo:400: 00010000:00080000:1.0:1788837607.869703:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa734700 x1875732036876928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837607.869713:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036876928:0@lo:400: 00010000:00080000:1.0:1788837607.869725:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa735f80 x1875732036877440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837607.869733:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036877440:0@lo:400: 00000100:00100000:1.0:1788837607.869744:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036876800:0@lo:400: 00010000:00080000:1.0:1788837607.869769:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa735880 x1875732036877824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837607.869794:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036877824:0@lo:400: 00000100:00100000:0.0:1788837607.871298:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837607.871309:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036877696:12345-0@lo:400: 00000100:00100000:0.0:1788837607.871380:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036877696:12345-0@lo:400: Request processed in 73us (4325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837607.871387:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788837607.871427:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa735500 x1875732036877696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837607.871455:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036877696:0@lo:400: 00000100:00100000:2.0:1788837607.871948:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036877568:0@lo:400: 00000100:00100000:1.0:1788837607.872590:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837607.872655:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036877056:0@lo:400: 00000100:00100000:2.0:1788837607.872914:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036877568 00000100:00100000:2.0:1788837607.872922:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036877568 00000100:00100000:2.0:1788837607.873352:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788837607.873364:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036877568:12345-0@lo:400: 00000100:00100000:2.0:1788837607.873430:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036877568:12345-0@lo:400: Request processed in 69us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837607.873437:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788837607.873503:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788837607.873911:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa736a00 x1875732036877568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837607.873926:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036877568:0@lo:400: 00010000:00010000:1.0:1788837608.123808:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837609.155474:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837609.401948:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837609.401973:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036878208:0@lo:41: 00000100:00100000:0.0:1788837609.402043:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837609.402163:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036878208 00000100:00100000:1.0:1788837609.402170:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036878208 00000100:00100000:1.0:1788837609.402220:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788837609.402229:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036878208:12345-0@lo:41: 00000004:00000024:1.0:1788837609.402268:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788837609.402318:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036878208:12345-0@lo:41: Request processed in 90us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837609.402325:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788837609.402565:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036878208:0@lo:41: 00010000:00010000:1.0:1788837610.171519:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837610.428841:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837610.428867:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036878336:0@lo:41: 00000100:00100000:1.0:1788837610.429332:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837610.429576:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036878336 00000100:00100000:0.0:1788837610.429585:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036878336 00000100:00100000:0.0:1788837610.429668:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788837610.429679:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036878336:12345-0@lo:41: 00000004:00000024:0.0:1788837610.429724:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788837610.429844:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036878336:0@lo:41: 00000100:00100000:0.0:1788837610.430061:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036878336:12345-0@lo:41: Request processed in 383us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837610.430069:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1788837611.196481:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837612.221008:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837612.985355:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036878592:0@lo:13: 00000100:00100000:0.0:1788837612.985425:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837612.985489:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036878592 00000100:00100000:0.0:1788837612.985495:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036878592 00000100:00100000:0.0:1788837612.985546:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837612.985555:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036878592:12345-0@lo:13: 00002000:00000024:0.0:1788837612.985590:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837612.985634:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036878592:12345-0@lo:13: Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837612.985641:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788837612.985671:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837612.985700:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c25b5c00 x1875732036878592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837612.985717:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036878592:0@lo:13: 00000100:00100000:1.0:1788837612.987315:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036878720:0@lo:400: 00000100:00100000:1.0:1788837612.987437:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837612.987540:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036879232:0@lo:400: 00000100:00100000:1.0:1788837612.987699:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837612.987727:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788837612.987736:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732036879104:0@lo:400: 00000100:00100000:1.0:1788837612.987760:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837612.987794:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036879616:0@lo:400: 00000100:00100000:1.0:1788837612.987814:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837612.987847:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036878720 00000100:00100000:1.0:1788837612.987852:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036878720 00000100:00100000:1.0:1788837612.987892:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788837612.987901:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:3651:x1875732036878720:12345-0@lo:400: 00000100:00100000:1.0:1788837612.988315:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:3651:x1875732036878720:12345-0@lo:400: Request processed in 43us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837612.988323:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788837612.988360:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036879232 00000100:00100000:1.0:1788837612.988364:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036879232 00000100:00100000:1.0:1788837612.988385:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788837612.988404:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036879232:12345-0@lo:400: 00000100:00100000:1.0:1788837612.988439:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036879232:12345-0@lo:400: Request processed in 37us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837612.988443:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788837612.988459:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036879104 00000100:00100000:1.0:1788837612.988462:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036879104 00000100:00100000:1.0:1788837612.988487:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788837612.988493:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732036879104:12345-0@lo:400: 00000100:00100000:1.0:1788837612.988523:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732036879104:12345-0@lo:400: Request processed in 30us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837612.988529:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788837612.988545:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036879616 00000100:00100000:1.0:1788837612.988548:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036879616 00000100:00100000:1.0:1788837612.988594:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837612.988800:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036879616:12345-0@lo:400: 00000100:00100000:1.0:1788837612.988833:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036879616:12345-0@lo:400: Request processed in 36us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837612.988839:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788837612.989015:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c2510000 x1875732036879104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837612.989092:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732036879104:0@lo:400: 00010000:00080000:1.0:1788837612.989274:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c2512300 x1875732036879616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837612.989283:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036879616:0@lo:400: 00000100:00100000:1.0:1788837612.989294:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036878720:0@lo:400: 00000100:00100000:1.0:1788837612.989318:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036879232:0@lo:400: 00000100:00080000:1.0:1788837612.989362:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837613.007588:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036878464:0@lo:13: 00000100:00100000:3.0:1788837613.007675:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837613.007710:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036878464 00000100:00100000:3.0:1788837613.007717:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036878976:0@lo:400: 00000100:00100000:0.0:1788837613.007718:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036878464 00000100:00100000:3.0:1788837613.007743:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837613.007762:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788837613.007765:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732036879488:0@lo:400: 00000100:00100000:0.0:1788837613.007771:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036878464:12345-0@lo:13: 00000100:00100000:3.0:1788837613.007807:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788837613.007811:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837613.007828:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788837613.007835:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036878848:0@lo:400: 00000100:00100000:0.0:1788837613.007848:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036878464:12345-0@lo:13: Request processed in 79us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837613.007855:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837613.007855:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788837613.007887:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036879360:0@lo:400: 00000100:00100000:3.0:1788837613.007906:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788837613.007934:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c25b6300 x1875732036878464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837613.007961:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036878464:0@lo:13: 00000100:00100000:3.0:1788837613.007988:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036879488 00000100:00100000:3.0:1788837613.007990:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036879488 00000100:00100000:3.0:1788837613.008016:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036878848 00000100:00100000:3.0:1788837613.008028:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036878848 00000100:00100000:3.0:1788837613.008040:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036879360 00000100:00100000:3.0:1788837613.008042:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036879360 00000100:00100000:3.0:1788837613.008055:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788837613.008061:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732036879488:12345-0@lo:400: 00000100:00100000:3.0:1788837613.008108:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732036879488:12345-0@lo:400: Request processed in 47us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837613.008220:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036878976 00000100:00100000:1.0:1788837613.008225:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036878976 00000100:00100000:1.0:1788837613.008253:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788837613.008259:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036878976:12345-0@lo:400: 00000100:00100000:1.0:1788837613.008295:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036878976:12345-0@lo:400: Request processed in 36us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837613.008301:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788837613.008318:0:6524:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788837613.008325:0:6524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788837613.008340:0:6526:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788837613.008495:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837613.008821:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837613.008831:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036878848:12345-0@lo:400: 00000100:00100000:1.0:1788837613.009032:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036878848:12345-0@lo:400: Request processed in 203us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837613.009039:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837613.009054:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788837613.009062:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036879360:12345-0@lo:400: 00000100:00100000:1.0:1788837613.009292:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036879360:12345-0@lo:400: Request processed in 231us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837613.009299:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788837613.009321:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837613.009325:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788837613.011452:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7d40a80 x1875732036878848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837613.011487:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036878848:0@lo:400: 00010000:00080000:3.0:1788837613.011504:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c2513800 x1875732036879360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837613.011513:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036879360:0@lo:400: 00000100:00100000:3.0:1788837613.011525:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036878976:0@lo:400: 00010000:00080000:3.0:1788837613.011536:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c2513100 x1875732036879488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837613.011543:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732036879488:0@lo:400: 00010000:00010000:1.0:1788837613.241166:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837614.265024:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837614.520933:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036879744:0@lo:41: 00000100:00100000:2.0:1788837614.521015:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837614.521109:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036879744 00000100:00100000:2.0:1788837614.521116:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036879744 00000100:00100000:2.0:1788837614.521158:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788837614.521167:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036879744:12345-0@lo:41: 00000004:00000024:2.0:1788837614.521197:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788837614.521237:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036879744:12345-0@lo:41: Request processed in 71us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837614.521243:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788837614.521284:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036879744:0@lo:41: 00010000:00010000:1.0:1788837615.291471:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837615.546016:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036879872:0@lo:41: 00000100:00100000:3.0:1788837615.546101:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837615.546352:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036879872 00000100:00100000:0.0:1788837615.546361:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036879872 00000100:00100000:0.0:1788837615.546419:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788837615.546428:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036879872:12345-0@lo:41: 00000004:00000024:0.0:1788837615.546462:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788837615.546524:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036879872:12345-0@lo:41: Request processed in 96us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837615.546531:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788837615.546720:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036879872:0@lo:41: 00000020:01000004:2.0:1788837616.120684:0:9517:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788837616.120688:0:9517:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788837616.120689:0:9517:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788837616.120887:0:9517:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff889ae7ed4800 00000020:01000004:2.0:1788837616.120903:0:9517:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788837616.120917:0:9517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788837616.120948:0:9517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8899c2668000) 00000020:00000080:2.0:1788837616.120968:0:9517:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788837616.174953:0:9517:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788837616.175009:0:9517:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1788837616.211751:0:9517:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788837616.212046:0:9517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788837616.212060:0:9517:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788837616.212071:0:9517:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x57f6d4e926aeee3e 00000020:01000004:2.0:1788837616.212078:0:9517:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788837616.212099:0:9517:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788837616.212102:0:9517:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788837616.212108:0:9517:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788837616.212133:0:9517:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788837616.212137:0:9517:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788837616.226946:0:9517:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788837616.226984:0:9517:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.103@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788837616.226988:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788837616.226994:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788837616.226995:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837616.226997:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837616.226998:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837616.226999:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837616.227000:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837616.227002:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788837616.227003:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788837616.227004:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837616.227006:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788837616.227010:0:9517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788837616.227012:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788837616.227013:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788837616.227014:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837616.227015:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837616.227015:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837616.227016:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837616.227017:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837616.227018:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788837616.227019:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788837616.227020:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837616.227021:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788837616.227058:0:9517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788837616.227077:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa737100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036880000:0@lo:253: 00000100:00100000:2.0:1788837616.227145:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837616.227250:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837616.227360:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036880000 00000100:00100000:1.0:1788837616.227367:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036880000 00000100:00100000:1.0:1788837616.227453:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788837616.227462:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:9517:x1875732036880000:12345-0@lo:253: 20000000:01000000:1.0:1788837616.227499:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788837616.227503:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788837616.227508:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788837616.227511:0:6518:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788837616.227722:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837616.228017:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1788837616.228030:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788837616.228047:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1788837616.228053:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788837616.228066:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1788837616.228082:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788837616.228163:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788837616.228178:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.103@tcp 20000000:01000000:1.0:1788837616.228180:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:1.0:1788837616.228193:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788837616.228200:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788837616.228214:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788837616.228219:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:1.0:1788837616.228232:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788837616.228239:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788837616.228254:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788837616.228270:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788837616.228338:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788837616.228349:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.103@tcp 20000000:01000000:1.0:1788837616.228351:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:1.0:1788837616.228364:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788837616.228369:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788837616.228391:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788837616.228396:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:1.0:1788837616.228410:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1788837616.228416:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788837616.228428:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1788837616.228444:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1788837616.229009:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1788837616.229022:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.103@tcp 20000000:01000000:1.0:1788837616.229024:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:1.0:1788837616.229039:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1788837616.229057:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788837616.229074:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1788837616.229080:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:1.0:1788837616.229094:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1788837616.229099:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788837616.229127:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1788837616.229145:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1788837616.229159:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788837616.229162:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788837616.229166:0:6518:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788837616.229210:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788837616.229214:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788837616.229670:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1788837616.229690:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1788837616.229706:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788837616.229908:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788837616.229930:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788837616.229947:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1788837616.229958:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788837616.229960:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788837616.230312:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1788837616.230329:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1788837616.230341:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788837616.230484:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788837616.230502:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788837616.230514:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1788837616.230524:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788837616.230526:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788837616.230863:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1788837616.230881:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1788837616.230896:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1788837616.231097:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1788837616.231118:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1788837616.231132:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1788837616.231160:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788837616.231162:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788837616.231537:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1788837616.231561:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1788837616.231573:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788837616.231696:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788837616.231713:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788837616.231725:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788837616.231733:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788837616.231739:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788837616.232092:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1788837616.232210:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1788837616.232228:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1788837616.232242:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:2.0:1788837616.232256:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788837616.232276:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.232294:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889b02171c00/0x57f6d4e926aeed3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeed34 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.232301:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeed65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeed5e expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.232307:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac0031400/0x57f6d4e926aeeda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeed9d expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.232313:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa6dac00/0x57f6d4e926aeedc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeedb9 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.232319:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeedea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeede3 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.232324:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926aeee06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeedff expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.232331:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa6daa00/0x57f6d4e926aeee30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeee29 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.232348:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.232387:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa6daa00/0x57f6d4e926aeee30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeee29 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.232400:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889afa6daa00/0x57f6d4e926aeee30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeee29 expref: 21 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837616.232414:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036880128:0@lo:104: 00000100:00100000:2.0:1788837616.232477:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837616.232565:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926aeee06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeedff expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.232573:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926aeee06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeedff expref: 21 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837616.232582:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036880256:0@lo:104: 00000100:00100000:2.0:1788837616.232613:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837616.232756:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeedea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeede3 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.232765:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeedea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeede3 expref: 21 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837616.233105:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036880384:0@lo:104: 00000100:00100000:2.0:1788837616.233143:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837616.233343:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036880128 00000100:00100000:1.0:1788837616.233351:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036880128 00000100:00100000:1.0:1788837616.233392:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036880256 00000100:00100000:1.0:1788837616.233394:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036880256 00000100:00100000:1.0:1788837616.233408:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837616.233416:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa734a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6518:x1875732036880128:12345-0@lo:104: 00010000:00010000:1.0:1788837616.233438:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeee30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.233499:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788837616.233505:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa734a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6518:x1875732036880128:12345-0@lo:104: Request processed in 90us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837616.233512:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837616.233531:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788837616.233537:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa735880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6518:x1875732036880256:12345-0@lo:104: 00010000:00010000:1.0:1788837616.233544:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeee06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.233575:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788837616.233580:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa735880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6518:x1875732036880256:12345-0@lo:104: Request processed in 44us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837616.233586:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788837616.233624:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837616.233631:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeee30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.233638:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837616.233643:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeee30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.233651:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeee30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837616.233658:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeee30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837616.233671:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837616.233698:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.233704:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837616.233720:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.233726:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aeee29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee30 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.233737:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837616.233740:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeee06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.233745:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dbe00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837616.233747:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeee06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.233753:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeee06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837616.233758:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeee06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837616.233762:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837616.233796:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.233802:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837616.233894:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837616.233908:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837616.233921:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036880512:0@lo:103: 00000100:00100000:3.0:1788837616.233953:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.233990:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036880512 00000100:00100000:3.0:1788837616.233994:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036880512 00010000:00010000:3.0:1788837616.234012:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa6daa00/0x57f6d4e926aeee30 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeee29 expref: 22 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837616.234033:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788837616.234039:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:3648:x1875732036880512:12345-0@lo:103: 00010000:00010000:3.0:1788837616.234048:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837616.234053:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa6daa00/0x57f6d4e926aeee30 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeee29 expref: 22 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.234064:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa6daa00/0x57f6d4e926aeee30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeee29 expref: 22 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.234080:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837616.234107:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:3648:x1875732036880512:12345-0@lo:103: Request processed in 68us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.234113:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788837616.234147:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036880512:0@lo:103: 00000100:00100000:3.0:1788837616.234221:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036880640:0@lo:103: 00000100:00100000:3.0:1788837616.234245:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837616.234288:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.234296:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeedff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee06 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.234305:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837616.234307:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837616.234309:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837616.234487:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa6dac00/0x57f6d4e926aeedc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeedb9 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.234504:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889afa6dac00/0x57f6d4e926aeedc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeedb9 expref: 21 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837616.234514:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036880768:0@lo:104: 00000100:00100000:2.0:1788837616.234538:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837616.234556:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac0031400/0x57f6d4e926aeeda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeed9d expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.234565:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac0031400/0x57f6d4e926aeeda4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeed9d expref: 21 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837616.234573:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036880896:0@lo:104: 00000100:00100000:2.0:1788837616.234593:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837616.234621:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeed65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeed5e expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.234628:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeed65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeed5e expref: 21 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837616.234635:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036881024:0@lo:104: 00000100:00100000:2.0:1788837616.234655:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837616.234684:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889b02171c00/0x57f6d4e926aeed3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeed34 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.234692:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889b02171c00/0x57f6d4e926aeed3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeed34 expref: 21 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837616.234700:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036881152:0@lo:104: 00000100:00100000:2.0:1788837616.234723:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f40840 going to sleep for 11 seconds 00010000:00010000:2.0:1788837616.234736:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6daa00/0x57f6d4e926aeee30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeee29 expref: 21 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837616.234746:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036880128:0@lo:104: 00000100:00100000:2.0:1788837616.234755:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036880256:0@lo:104: 00000100:00100000:2.0:1788837616.234826:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036880640 00000100:00100000:2.0:1788837616.234830:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036880640 00010000:00010000:2.0:1788837616.234846:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926aeee06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeedff expref: 21 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837616.234867:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837616.234873:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:3650:x1875732036880640:12345-0@lo:103: 00010000:00010000:2.0:1788837616.234882:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837616.234886:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926aeee06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeedff expref: 21 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.234895:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926aeee06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeedff expref: 21 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.234905:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926aeee06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeedff expref: 21 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.234914:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837616.235037:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788837616.235055:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837616.235065:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036880384 00000100:00100000:1.0:1788837616.235068:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036880384 00000100:00100000:1.0:1788837616.235086:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036880768 00000100:00100000:1.0:1788837616.235089:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036880768 00000100:00100000:1.0:1788837616.235098:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036880896 00000100:00100000:1.0:1788837616.235100:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036880896 00000100:00100000:1.0:1788837616.235108:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036881024 00000100:00100000:1.0:1788837616.235110:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036881024 00000100:00100000:1.0:1788837616.235117:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036881152 00000100:00100000:1.0:1788837616.235120:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036881152 00000100:00100000:1.0:1788837616.235130:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788837616.235136:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa735f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+7:6518:x1875732036880384:12345-0@lo:104: 00010000:00010000:1.0:1788837616.235144:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeedea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.235182:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788837616.235187:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa735f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+7:6518:x1875732036880384:12345-0@lo:104: Request processed in 52us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837616.235194:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788837616.235208:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837616.235221:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa737480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+6:6518:x1875732036880768:12345-0@lo:104: 00010000:00010000:1.0:1788837616.235229:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeedc0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.235260:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788837616.235265:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa737480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+6:6518:x1875732036880768:12345-0@lo:104: Request processed in 46us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837616.235270:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837616.235283:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837616.235289:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa735c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+5:6518:x1875732036880896:12345-0@lo:104: 00010000:00010000:1.0:1788837616.235295:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeda4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.235322:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788837616.235327:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa735c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+5:6518:x1875732036880896:12345-0@lo:104: Request processed in 38us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837616.235332:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837616.235343:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788837616.235349:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2487450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6518:x1875732036881024:12345-0@lo:104: 00010000:00010000:1.0:1788837616.235355:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeed65 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.235378:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788837616.235382:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2487450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6518:x1875732036881024:12345-0@lo:104: Request processed in 35us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837616.235387:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788837616.235411:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788837616.235423:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2510000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6518:x1875732036881152:12345-0@lo:104: 00010000:00010000:1.0:1788837616.235430:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeed3b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.235455:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788837616.235459:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2510000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6518:x1875732036881152:12345-0@lo:104: Request processed in 39us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837616.235464:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788837616.235478:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788837616.235483:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeedea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.235490:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16000 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837616.235493:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeedea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.235500:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeedea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837616.235507:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeedea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837616.235512:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837616.235533:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeedea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.235539:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788837616.235707:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:3650:x1875732036880640:12345-0@lo:103: Request processed in 833us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837616.235714:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837616.235736:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036881280:0@lo:103: 00000100:00100000:2.0:1788837616.235760:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837616.235960:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036880384:0@lo:104: 00000100:00100000:2.0:1788837616.235967:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036880768:0@lo:104: 00000100:00100000:2.0:1788837616.235974:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036880896:0@lo:104: 00000100:00100000:2.0:1788837616.235980:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036881024:0@lo:104: 00000100:00100000:2.0:1788837616.235986:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875732036881152:0@lo:104: 00010000:00010000:2.0:1788837616.236007:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236063:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeedea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236080:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b16000/0x57f6d4e926aeede3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeedea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236091:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788837616.236095:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeedc0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236100:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da200 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837616.236103:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeedc0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236109:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeedc0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837616.236116:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeedc0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837616.236121:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837616.236137:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeedc0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236143:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837616.236165:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeedc0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236172:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeedb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeedc0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236181:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788837616.236190:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeda4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236196:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17800 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837616.236199:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeeda4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236206:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeeda4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837616.236212:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeeda4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837616.236217:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837616.236231:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeda4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236237:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837616.236242:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeda4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236248:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b17800/0x57f6d4e926aeed9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeda4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236257:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837616.236259:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeed65 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236265:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889b02170a00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837616.236267:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeed65 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236284:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeed65 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837616.236291:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeed65 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837616.236295:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837616.236308:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeed65 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236314:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837616.236321:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeed65 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236328:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889b02170a00/0x57f6d4e926aeed5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeed65 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236337:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837616.236340:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeed3b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236346:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8400 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837616.236348:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeed3b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236355:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeed3b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837616.236361:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeed3b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837616.236371:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837616.236384:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeed3b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236389:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837616.236394:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeed3b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236400:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926aeed34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeed3b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.236412:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837616.236414:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837616.236416:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837616.236459:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036881536:0@lo:103: 00000100:00100000:2.0:1788837616.236489:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.236546:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036880640:0@lo:103: 00000100:00100000:3.0:1788837616.236568:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036881664:0@lo:103: 00000100:00100000:3.0:1788837616.236593:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837616.236617:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036881280 00000100:00100000:0.0:1788837616.236623:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036881280 00010000:00010000:0.0:1788837616.236648:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeedea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeede3 expref: 20 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837616.236687:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837616.236695:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:3651:x1875732036881280:12345-0@lo:103: 00010000:00010000:0.0:1788837616.236705:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837616.236710:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeedea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeede3 expref: 20 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.236720:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeedea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeede3 expref: 20 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.236731:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeedea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeede3 expref: 20 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.236743:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837616.236769:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:3651:x1875732036881280:12345-0@lo:103: Request processed in 77us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837616.236799:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837616.236999:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837616.237007:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036881408:0@lo:103: 00000100:00100000:2.0:1788837616.237035:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036881792:0@lo:103: 00000100:00100000:0.0:1788837616.237100:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036881536 00000100:00100000:0.0:1788837616.237105:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036881536 00010000:00010000:0.0:1788837616.237120:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac0031400/0x57f6d4e926aeeda4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeed9d expref: 19 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837616.237145:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837616.237152:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8565850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:3649:x1875732036881536:12345-0@lo:103: 00010000:00010000:0.0:1788837616.237159:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837616.237163:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac0031400/0x57f6d4e926aeeda4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeed9d expref: 19 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.237171:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac0031400/0x57f6d4e926aeeda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeed9d expref: 19 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.237188:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac0031400/0x57f6d4e926aeeda4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeed9d expref: 19 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.237197:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837616.237292:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8565850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:3649:x1875732036881536:12345-0@lo:103: Request processed in 140us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837616.237299:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788837616.237440:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837616.237480:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837616.237584:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036881280:0@lo:103: 00000100:00100000:0.0:1788837616.237617:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837616.237632:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036881664 00000100:00100000:1.0:1788837616.237637:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036881664 00010000:00010000:1.0:1788837616.237652:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeed65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeed5e expref: 18 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837616.237665:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036881792 00000100:00100000:1.0:1788837616.237667:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036881792 00010000:00010000:1.0:1788837616.237678:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889b02171c00/0x57f6d4e926aeed3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeed34 expref: 19 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837616.237689:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837616.237695:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:3650:x1875732036881664:12345-0@lo:103: 00010000:00010000:1.0:1788837616.237702:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837616.237707:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeed65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeed5e expref: 19 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.237728:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeed65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeed5e expref: 19 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.237739:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeed65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeed5e expref: 19 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.237749:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837616.237901:0:6509:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788837616.237910:0:6509:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788837616.238013:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:3650:x1875732036881664:12345-0@lo:103: Request processed in 112us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837616.238021:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837616.238035:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788837616.238042:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2652a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:3651:x1875732036881792:12345-0@lo:103: 00010000:00010000:1.0:1788837616.238049:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837616.238053:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889b02171c00/0x57f6d4e926aeed3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeed34 expref: 17 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.238060:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889b02171c00/0x57f6d4e926aeed3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeed34 expref: 17 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.238069:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889b02171c00/0x57f6d4e926aeed3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeed34 expref: 17 pid: 6519 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.238078:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837616.238144:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2652a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:3651:x1875732036881792:12345-0@lo:103: Request processed in 103us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837616.238151:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788837616.238194:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036881792:0@lo:103: 00000100:00100000:3.0:1788837616.238295:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036881664:0@lo:103: 00000100:00100000:0.0:1788837616.238420:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036881536:0@lo:103: 00000100:00100000:2.0:1788837616.238491:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036881408 00000100:00100000:2.0:1788837616.238495:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036881408 00010000:00010000:2.0:1788837616.238512:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa6dac00/0x57f6d4e926aeedc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeedb9 expref: 16 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837616.238621:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788837616.238628:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2651500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:3649:x1875732036881408:12345-0@lo:103: 00010000:00010000:0.0:1788837616.238637:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837616.238641:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa6dac00/0x57f6d4e926aeedc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeedb9 expref: 16 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.238650:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa6dac00/0x57f6d4e926aeedc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeedb9 expref: 16 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.238661:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6dac00/0x57f6d4e926aeedc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeedb9 expref: 16 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.238670:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.238678:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.238699:0:9528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.238707:0:9528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.238714:0:9528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.238720:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.238726:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837616.238731:0:9528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.238738:0:9528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.238761:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.238770:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837616.238836:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2651500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:3649:x1875732036881408:12345-0@lo:103: Request processed in 209us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837616.238842:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788837616.238868:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036881408:0@lo:103: 00010000:00010000:3.0:1788837616.238957:0:6518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.238966:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.238972:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6db400/0x57f6d4e926aeee45 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788837616.238986:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788837616.240796:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:9517:x1875732036880000:12345-0@lo:253: Request processed in 13303us (13618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837616.240830:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788837616.240973:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa737100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036880000:0@lo:253: 10000000:01000000:3.0:1788837616.240988:0:9517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788837616.240992:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788837616.240993:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788837616.240995:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837616.240996:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788837616.240997:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837616.240998:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837616.241000:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788837616.241001:0:9517:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788837616.241003:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837616.241004:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788837616.241023:0:9517:0:(tgt_mount.c:101:server_register_mount()) register mount ffff889ae7ed4800 from lustre-OST0001 10000000:01000000:3.0:1788837616.241051:0:9517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788837616.241054:0:9517:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788837616.241062:0:9517:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff889ac85799b8 local copy 10000000:01000000:3.0:1788837616.241066:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788837616.241104:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.241114:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.241125:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837616.241143:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036881920:0@lo:101: 00000100:00100000:3.0:1788837616.241176:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.241221:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa521d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837616.241281:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036881920 00000100:00100000:1.0:1788837616.241288:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036881920 00000100:00100000:1.0:1788837616.241333:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788837616.241342:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:9517:x1875732036881920:12345-0@lo:101: 00010000:00010000:1.0:1788837616.241353:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837616.241366:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c8600/0x57f6d4e926aeee53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeee4c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.241388:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c8600/0x57f6d4e926aeee53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeee4c expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.241399:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c8600/0x57f6d4e926aeee53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeee4c expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.241406:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8600, rc 0) 00000100:00100000:1.0:1788837616.241436:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:9517:x1875732036881920:12345-0@lo:101: Request processed in 95us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837616.241441:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788837616.241583:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036881920:0@lo:101: 00010000:00010000:3.0:1788837616.241597:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x57f6d4e926aeee53 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.241617:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x57f6d4e926aeee53 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837616.241702:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036882048:0@lo:501: 00000100:00100000:3.0:1788837616.241726:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.241746:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa521d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837616.241830:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036882048 00000100:00100000:3.0:1788837616.241834:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036882048 00000100:00100000:3.0:1788837616.241861:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788837616.241867:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:9517:x1875732036882048:12345-0@lo:501: 00000100:00100000:3.0:1788837616.241921:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:9517:x1875732036882048:12345-0@lo:501: Request processed in 54us (194us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788837616.241927:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788837616.241968:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036882048:0@lo:501: 10000000:01000000:3.0:1788837616.241979:0:9517:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788837616.241996:0:9517:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788837616.242001:0:9517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x57f6d4e926aeee53 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.242008:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x57f6d4e926aeee53 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.242014:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x57f6d4e926aeee53 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.242029:0:9517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788837616.242047:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff889ae7ed4800 10000000:01000000:3.0:1788837616.242051:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788837616.242056:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788837616.242058:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788837616.242062:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788837616.242064:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788837616.242079:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.242086:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.242094:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837616.242105:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036882176:0@lo:101: 00000100:00100000:3.0:1788837616.242127:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.242146:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837616.242158:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036882176 00000100:00100000:3.0:1788837616.242161:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036882176 00000100:00100000:3.0:1788837616.242180:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788837616.242186:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:9517:x1875732036882176:12345-0@lo:101: 00010000:00010000:3.0:1788837616.242192:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837616.242200:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeee61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeee5a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.242213:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeee61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeee5a expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.242221:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeee61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeee5a expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.242228:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16e00, rc 0) 00000100:00100000:3.0:1788837616.242255:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036882176:12345-0@lo:101: Request processed in 69us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.242261:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788837616.242292:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036882176:0@lo:101: 00010000:00010000:3.0:1788837616.242301:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee61 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.242308:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeee61 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837616.242351:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036882304:0@lo:501: 00000100:00100000:3.0:1788837616.242374:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.242386:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837616.242402:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036882304 00000100:00100000:3.0:1788837616.242405:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036882304 00000100:00100000:3.0:1788837616.242425:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788837616.242431:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036882304:12345-0@lo:501: 00000100:00100000:3.0:1788837616.242508:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036882304:12345-0@lo:501: Request processed in 77us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.242515:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00010000:3.0:1788837616.242536:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837616.242542:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x57f6d4e926aeee53 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.242548:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17e00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837616.242552:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x57f6d4e926aeee53 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.242559:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x57f6d4e926aeee53 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837616.242565:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x57f6d4e926aeee53 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837616.242571:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837616.242587:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x57f6d4e926aeee53 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.242592:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837616.242628:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x57f6d4e926aeee53 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.242634:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b17e00/0x57f6d4e926aeee4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x57f6d4e926aeee53 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.242651:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837616.242653:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837616.242655:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837616.242671:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036882304:0@lo:501: 00000100:00100000:3.0:1788837616.242694:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036882560:0@lo:503: 00000100:00100000:3.0:1788837616.242731:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.242743:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837616.242755:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036882560 00000100:00100000:3.0:1788837616.242758:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036882560 00000100:00100000:3.0:1788837616.242799:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788837616.242806:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036882560:12345-0@lo:503: 00000100:00100000:3.0:1788837616.242876:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036882560:12345-0@lo:503: Request processed in 70us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.242882:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788837616.242918:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036882560:0@lo:503: 00000040:00080000:3.0:1788837616.243156:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788837616.243222:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036882688:0@lo:502: 00000100:00100000:3.0:1788837616.243255:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.243269:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837616.243283:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036882688 00000100:00100000:3.0:1788837616.243287:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036882688 00000100:00100000:3.0:1788837616.243308:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788837616.243314:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036882688:12345-0@lo:502: 00000100:00100000:3.0:1788837616.243385:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036882688:12345-0@lo:502: Request processed in 70us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.243399:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788837616.243438:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036882688:0@lo:502: 00000040:00080000:3.0:1788837616.243627:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788837616.243652:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788837616.243667:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788837616.243682:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788837616.243696:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788837616.243709:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788837616.243727:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036882816:0@lo:502: 00000100:00100000:3.0:1788837616.243759:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.243773:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837616.243806:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036882816 00000100:00100000:3.0:1788837616.243809:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036882816 00000100:00100000:3.0:1788837616.243830:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788837616.243836:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036882816:12345-0@lo:502: 00000100:00100000:3.0:1788837616.243898:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036882816:12345-0@lo:502: Request processed in 61us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.243904:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788837616.243940:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036882816:0@lo:502: 00000040:00080000:3.0:1788837616.243972:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788837616.243979:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000100:00100000:2.0:1788837616.244355:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036882432:0@lo:103: 00000100:00100000:2.0:1788837616.244387:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837616.244440:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036882432 00000100:00100000:2.0:1788837616.244444:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036882432 00000100:00100000:2.0:1788837616.244472:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837616.244487:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:3648:x1875732036882432:12345-0@lo:103: 00010000:00010000:2.0:1788837616.244497:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837616.244513:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c8600/0x57f6d4e926aeee53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aeee4c expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.244525:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837616.244551:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:3648:x1875732036882432:12345-0@lo:103: Request processed in 65us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837616.244558:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837616.244583:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036882432:0@lo:103: 00000020:01000000:2.0:1788837616.245322:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788837616.245330:0:9529:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788837616.245336:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837616.245338:0:9529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788837616.245343:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788837616.245358:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8899c266cd28) 00000020:00000080:2.0:1788837616.245379:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788837616.245384:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788837616.245443:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ae7ed4800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788837616.245451:0:9529:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788837616.245457:0:9529:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x57f6d4e926aeee6f 00010000:00010000:2.0:1788837616.250414:0:9529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788837616.250714:0:9529:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788837616.254456:0:9529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788837616.254913:0:9529:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788837616.259482:0:9529:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788837616.259672:0:9529:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788837616.266339:0:9529:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788837616.267694:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788837616.267705:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837616.267716:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837616.267719:0:9529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788837616.267723:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837616.267728:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837616.267729:0:9529:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788837616.267733:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788837616.267735:0:9529:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788837616.267754:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837616.267757:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837616.267758:0:9529:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788837616.267761:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788837616.271886:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788837616.271939:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788837616.271995:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee61 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.272009:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee61 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837616.272017:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ae7ed4800 from 1 10000000:01000000:2.0:1788837616.272020:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837616.272056:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.272065:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837616.272076:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837616.272100:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036882944:0@lo:101: 00000100:00100000:2.0:1788837616.272165:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837616.272200:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f40c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837616.272265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036882944 00000100:00100000:3.0:1788837616.272272:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036882944 00000100:00100000:3.0:1788837616.272320:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788837616.272330:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:9517:x1875732036882944:12345-0@lo:101: 00010000:00010000:3.0:1788837616.272343:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837616.272362:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aeee7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeee76 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.272384:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aeee7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeee76 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.272394:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aeee7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeee76 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.272403:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17e00, rc 0) 00000100:00100000:3.0:1788837616.272447:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036882944:12345-0@lo:101: Request processed in 117us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.272454:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788837616.272503:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036882944:0@lo:101: 00010000:00010000:3.0:1788837616.272516:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee7d expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.272525:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeee7d expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837616.272627:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883072:0@lo:501: 00000100:00100000:3.0:1788837616.272654:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.272672:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af99716c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837616.272686:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036883072 00000100:00100000:3.0:1788837616.272690:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036883072 00000100:00100000:3.0:1788837616.272715:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788837616.272722:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036883072:12345-0@lo:501: 00000100:00100000:3.0:1788837616.273138:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036883072:12345-0@lo:501: Request processed in 415us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.273156:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788837616.277402:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883072:0@lo:501: 00000100:00100000:1.0:1788837616.277460:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883200:0@lo:503: 00000100:00100000:1.0:1788837616.278393:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837616.278467:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adeb73780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837616.278513:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036883200 00000100:00100000:2.0:1788837616.278520:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036883200 00000100:00100000:2.0:1788837616.278597:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788837616.278617:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036883200:12345-0@lo:503: 00000100:00100000:2.0:1788837616.278743:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036883200:12345-0@lo:503: Request processed in 129us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837616.278751:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788837616.278902:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883200:0@lo:503: 00000040:00080000:1.0:1788837616.279156:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788837616.279233:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883328:0@lo:502: 00000100:00100000:1.0:1788837616.279277:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837616.279494:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adeb73780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837616.279530:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036883328 00000100:00100000:2.0:1788837616.279535:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036883328 00000100:00100000:0.0:1788837616.279581:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788837616.279591:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036883328:12345-0@lo:502: 00000100:00100000:0.0:1788837616.279689:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036883328:12345-0@lo:502: Request processed in 100us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837616.279696:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788837616.279772:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883328:0@lo:502: 00000040:00080000:1.0:1788837616.279998:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788837616.280021:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788837616.280039:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883456:0@lo:502: 00000100:00100000:1.0:1788837616.280071:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837616.280083:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adeb73780 going to sleep for 11 seconds 00000100:00100000:0.0:1788837616.280196:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036883456 00000100:00100000:0.0:1788837616.280200:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036883456 00000100:00100000:0.0:1788837616.280219:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788837616.280224:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036883456:12345-0@lo:502: 00000100:00100000:0.0:1788837616.280292:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036883456:12345-0@lo:502: Request processed in 67us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837616.280298:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788837616.280371:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883456:0@lo:502: 00000040:00080000:1.0:1788837616.280405:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788837616.280412:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788837616.280921:0:9533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837616.280932:0:9533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837616.280935:0:9533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788837616.280941:0:9533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ae7ed4800 00000020:00000080:1.0:1788837616.280943:0:9533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788837616.280957:0:9533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837616.280960:0:9533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837616.280961:0:9533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788837616.280963:0:9533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788837616.281075:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788837616.281099:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837616.281120:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee7d expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.281131:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee7d expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837616.281188:0:9517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788837616.281191:0:9517:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff889ae7ed4800 10000000:01000000:0.0:1788837616.281194:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff889ae7ed4800 10000000:01000000:0.0:1788837616.281198:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788837616.281203:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ae7ed4800 from 1 10000000:01000000:0.0:1788837616.281205:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788837616.281229:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.281237:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.281246:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837616.281259:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2651880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883584:0@lo:101: 00000100:00100000:0.0:1788837616.281294:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837616.281321:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837616.281336:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036883584 00000100:00100000:0.0:1788837616.281339:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036883584 00000100:00100000:0.0:1788837616.281360:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788837616.281367:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9517:x1875732036883584:12345-0@lo:101: 00010000:00010000:0.0:1788837616.281375:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837616.281386:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac0031800/0x57f6d4e926aeee8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeee84 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.281407:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac0031800/0x57f6d4e926aeee8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeee84 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.281427:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac0031800/0x57f6d4e926aeee8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeee84 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.281435:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0031800, rc 0) 00000100:00100000:0.0:1788837616.281465:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9517:x1875732036883584:12345-0@lo:101: Request processed in 98us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837616.281471:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788837616.281504:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2651880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883584:0@lo:101: 00010000:00010000:0.0:1788837616.281515:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee8b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.281523:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeee8b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837616.281585:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2651880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883712:0@lo:501: 00000100:00100000:0.0:1788837616.281622:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837616.281636:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837616.281648:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036883712 00000100:00100000:0.0:1788837616.281651:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036883712 00000100:00100000:0.0:1788837616.281667:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788837616.281672:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9517:x1875732036883712:12345-0@lo:501: 00000100:00100000:0.0:1788837616.281748:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9517:x1875732036883712:12345-0@lo:501: Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837616.281754:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788837616.281872:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2651880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883712:0@lo:501: 00000100:00100000:0.0:1788837616.281909:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2651880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883840:0@lo:503: 00000100:00100000:0.0:1788837616.281947:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837616.281960:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837616.281972:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036883840 00000100:00100000:0.0:1788837616.281976:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036883840 00000100:00100000:0.0:1788837616.281993:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788837616.281998:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9517:x1875732036883840:12345-0@lo:503: 00000100:00100000:0.0:1788837616.282069:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9517:x1875732036883840:12345-0@lo:503: Request processed in 70us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837616.282076:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788837616.282113:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2651880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883840:0@lo:503: 00000040:00080000:0.0:1788837616.282312:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788837616.282371:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2651880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883968:0@lo:502: 00000100:00100000:0.0:1788837616.282399:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837616.282413:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837616.282424:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036883968 00000100:00100000:0.0:1788837616.282428:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036883968 00000100:00100000:0.0:1788837616.282444:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788837616.282450:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9517:x1875732036883968:12345-0@lo:502: 00000100:00100000:0.0:1788837616.282517:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9517:x1875732036883968:12345-0@lo:502: Request processed in 67us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837616.282523:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788837616.282557:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2651880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036883968:0@lo:502: 00000040:00080000:0.0:1788837616.282770:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788837616.282953:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788837616.282969:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788837616.282994:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788837616.283008:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788837616.283031:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788837616.283044:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788837616.283057:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788837616.283070:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788837616.283083:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788837616.283096:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788837616.283109:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788837616.283122:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788837616.283135:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788837616.283145:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788837616.283151:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788837616.283158:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788837616.283165:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788837616.283171:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788837616.283186:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788837616.283194:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788837616.283200:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788837616.283206:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788837616.283213:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788837616.283220:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788837616.283226:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788837616.283232:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788837616.283238:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788837616.283245:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788837616.283251:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788837616.283257:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788837616.283263:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788837616.283275:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788837616.283288:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788837616.283301:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788837616.283324:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788837616.283340:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1788837616.283354:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788837616.283377:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788837616.283389:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788837616.283396:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788837616.283402:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1788837616.283408:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788837616.283415:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788837616.283421:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788837616.283428:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1788837616.283443:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2651880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036884096:0@lo:502: 00000100:00100000:0.0:1788837616.283473:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837616.283486:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837616.283500:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036884096 00000100:00100000:0.0:1788837616.283503:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036884096 00000100:00100000:0.0:1788837616.283536:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788837616.283543:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9517:x1875732036884096:12345-0@lo:502: 00000100:00100000:0.0:1788837616.283619:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9517:x1875732036884096:12345-0@lo:502: Request processed in 75us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837616.283626:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788837616.283669:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2651880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036884096:0@lo:502: 00000040:00080000:0.0:1788837616.283705:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788837616.283712:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1788837616.285635:0:9534:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788837616.285653:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8899c266b370) 00000020:00000080:2.0:1788837616.285678:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1788837616.285766:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ae7ed4800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788837616.285770:0:9534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ae7ed4800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788837616.286226:0:9534:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ae7ed4800 3 00010000:00080000:2.0:1788837616.286258:0:9534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8899c3247800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.103@tcp at head 00010000:00010000:2.0:1788837616.287773:0:9534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1788837616.288007:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788837616.288045:0:9534:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788837616.288056:0:9534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x57f6d4e926aeee99 00000100:00080000:2.0:1788837616.288065:0:9534:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837616.288071:0:9534:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8899c3247800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837616.288103:0:9534:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c27bfb80 x1875732036884224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837616.288123:0:9534:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788837616.288473:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036884352:0@lo:400: 00000100:00100000:3.0:1788837616.288532:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.288563:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036884864:0@lo:400: 00000100:00100000:3.0:1788837616.288583:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.288613:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788837616.288619:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036884736:0@lo:400: 00000100:00100000:3.0:1788837616.288652:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.288672:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036885248:0@lo:400: 00000100:00100000:3.0:1788837616.288704:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.288729:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036884480:0@lo:400: 00000100:00100000:3.0:1788837616.288750:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.288765:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036884992:0@lo:400: 00000100:00100000:3.0:1788837616.288799:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.289107:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788837616.289113:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036884608:0@lo:400: 00000100:00100000:3.0:1788837616.289133:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.289149:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036885120:0@lo:400: 00000100:00100000:3.0:1788837616.289169:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.289201:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036884352 00000100:00100000:3.0:1788837616.289207:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036884352 00000100:00100000:3.0:1788837616.289239:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036884864 00000100:00100000:3.0:1788837616.289242:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036884864 00000100:00100000:3.0:1788837616.289265:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036884992 00000100:00100000:3.0:1788837616.289267:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036884992 00000100:00100000:3.0:1788837616.289279:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036884608 00000100:00100000:3.0:1788837616.289287:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036884608 00000100:00100000:3.0:1788837616.289305:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837616.289312:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036884352:12345-0@lo:400: 00000100:00100000:3.0:1788837616.289371:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036884352:12345-0@lo:400: Request processed in 59us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.289378:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837616.289392:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788837616.289398:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036884864:12345-0@lo:400: 00000100:00100000:3.0:1788837616.289424:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036884864:12345-0@lo:400: Request processed in 27us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.289429:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788837616.289440:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837616.289445:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036884992:12345-0@lo:400: 00000100:00100000:3.0:1788837616.289474:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036884992:12345-0@lo:400: Request processed in 29us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.289480:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837616.289492:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788837616.289497:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036884608:12345-0@lo:400: 00000100:00100000:3.0:1788837616.289521:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036884608:12345-0@lo:400: Request processed in 25us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.289527:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788837616.289546:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036884736 00000100:00100000:3.0:1788837616.289549:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036884736 00000100:00100000:3.0:1788837616.289571:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036884480 00000100:00100000:3.0:1788837616.289573:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036884480 00000100:00100000:3.0:1788837616.289584:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788837616.289589:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036884736:12345-0@lo:400: 00000100:00100000:3.0:1788837616.289637:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036884736:12345-0@lo:400: Request processed in 47us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.289643:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788837616.289655:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788837616.289660:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036884480:12345-0@lo:400: 00000100:00100000:3.0:1788837616.289684:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036884480:12345-0@lo:400: Request processed in 24us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.289689:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788837616.289705:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036885248 00000100:00100000:3.0:1788837616.289708:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036885248 00000100:00100000:3.0:1788837616.289731:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036885120 00000100:00100000:3.0:1788837616.289734:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036885120 00000100:00100000:3.0:1788837616.289751:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837616.289757:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036885248:12345-0@lo:400: 00000100:00100000:2.0:1788837616.290148:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837616.290157:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036885120:12345-0@lo:400: 00000100:00100000:2.0:1788837616.290192:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036885120:12345-0@lo:400: Request processed in 37us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837616.290197:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837616.290754:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036884736:0@lo:400: 00010000:00080000:1.0:1788837616.290770:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7e3ca80 x1875732036885248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837616.290795:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036885248:0@lo:400: 00010000:00080000:1.0:1788837616.290808:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c25b5880 x1875732036884352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837616.290816:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036884352:0@lo:400: 00010000:00080000:1.0:1788837616.290836:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c25b6a00 x1875732036884864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837616.290845:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036884864:0@lo:400: 00000100:00100000:3.0:1788837616.290915:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036885248:12345-0@lo:400: Request processed in 50us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.290925:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788837616.290943:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837616.290949:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788837616.290951:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788837616.290980:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c25b6680 x1875732036884608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837616.290989:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036884608:0@lo:400: 00010000:00080000:3.0:1788837616.291002:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ae7e3f480 x1875732036885120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837616.291010:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036885120:0@lo:400: 00000100:00100000:3.0:1788837616.291033:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036884480:0@lo:400: 00010000:00080000:3.0:1788837616.291044:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa5ee680 x1875732036884992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837616.291051:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036884992:0@lo:400: 00000100:00100000:0.0:1788837616.291191:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732036884224:0@lo:38: 00000100:00100000:0.0:1788837616.291235:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.291322:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036884224 00000100:00100000:3.0:1788837616.291327:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036884224 00000020:01000004:2.0:1788837616.291478:0:9534:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788837616.291492:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8899c26699b8) 00000020:00000080:2.0:1788837616.291511:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1788837616.291612:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ae7ed4800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788837616.291617:0:9534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ae7ed4800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788837616.291620:0:9534:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ae7ed4800 3 00010000:00080000:2.0:1788837616.291647:0:9534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8899c3245800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.103@tcp at head 00000100:00080000:1.0:1788837616.291957:0:9536:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8899c2511500 x1875732036885376/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837616.291966:0:9536:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdcd80 going to sleep for 0 seconds 00000100:00100000:3.0:1788837616.294584:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788837616.294594:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875732036884224:12345-0@lo:38: 00010000:00080000:3.0:1788837616.294638:0:6526:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:3.0:1788837616.294676:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x57f6d4e926aeeea7 00000004:00100000:3.0:1788837616.294694:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788837616.294726:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8899c27c4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837616.294833:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875732036884224:12345-0@lo:38: Request processed in 237us (3597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.294851:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788837616.294903:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c27bfb80 x1875732036884224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837616.294915:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788837616.294923:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788837616.294930:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788837616.294934:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788837616.294937:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c3247800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788837616.294943:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000804e8e03): req@ffff8899c2511500 x1875732036885376/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837616.294962:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732036884224:0@lo:38: 00000100:00100000:1.0:1788837616.295027:0:9536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837616.295049:0:9536:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdcd80 going to sleep for 11 seconds 00010000:00010000:2.0:1788837616.296176:0:9534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1788837616.296361:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788837616.296400:0:9534:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788837616.296408:0:9534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x57f6d4e926aeeeae 00000100:00080000:2.0:1788837616.296415:0:9534:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837616.296420:0:9534:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8899c3245800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837616.296445:0:9534:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c27be680 x1875732036885504/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837616.296467:0:9534:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788837616.296501:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036885376 00000100:00100000:2.0:1788837616.296505:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036885376 00000100:00100000:2.0:1788837616.296543:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837616.296550:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9536:x1875732036885376:12345-0@lo:901: 00000100:00100000:2.0:1788837616.296665:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9536:x1875732036885376:12345-0@lo:901: Request processed in 116us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837616.296672:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788837616.297162:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837616.297342:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875732036885504:0@lo:38: 00000100:00100000:2.0:1788837616.297385:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788837616.298693:0:9536:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c2511500 x1875732036885376/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788837632 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837616.298709:0:9536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9536:1875732036885376:0@lo:901: 00000100:00100000:3.0:1788837616.299154:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036885504 00000100:00100000:3.0:1788837616.299161:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036885504 00000100:00100000:3.0:1788837616.299201:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837616.299208:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875732036885504:12345-0@lo:38: 00010000:00080000:3.0:1788837616.299232:0:9317:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:3.0:1788837616.299263:0:9317:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x57f6d4e926aeeeb5 00000004:00100000:3.0:1788837616.299279:0:9317:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788837616.299311:0:9317:0:(import.c:65:import_set_state_nolock()) ffff8899c27c7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837616.299381:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875732036885504:12345-0@lo:38: Request processed in 171us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.299396:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788837616.299433:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c27be680 x1875732036885504/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837616.299442:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837616.299448:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788837616.299455:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788837616.299460:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788837616.299462:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c3245800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788837616.299466:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875732036885504:0@lo:38: 00000040:00080000:2.0:1788837616.302163:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1788837616.306581:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1788837616.306636:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788837616.306662:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee8b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837616.306676:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeee8b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788837616.306736:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788837616.306738:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788837616.306740:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837616.306741:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837616.306742:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837616.306744:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837616.306745:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788837616.306747:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837616.306748:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837616.306750:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837616.306751:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788837616.306755:0:9517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788837616.306757:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788837616.306759:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788837616.306760:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837616.306761:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837616.306762:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837616.306763:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837616.306764:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788837616.306765:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788837616.306766:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788837616.306767:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837616.306768:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788837616.306818:0:9517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788837616.306836:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036885632:0@lo:253: 00000100:00100000:1.0:1788837616.306905:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837616.306942:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac8570d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837616.307536:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036885632 00000100:00100000:2.0:1788837616.307544:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036885632 00000100:00100000:2.0:1788837616.307598:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788837616.307617:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9517:x1875732036885632:12345-0@lo:253: 20000000:01000000:2.0:1788837616.307645:0:6519:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788837616.307667:0:6519:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788837616.312618:0:6519:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788837616.312638:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788837616.313032:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9517:x1875732036885632:12345-0@lo:253: Request processed in 5411us (6121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837616.313043:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 20000000:01000000:3.0:1788837616.313159:0:6540:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788837616.313164:0:6540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788837616.313182:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.313196:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889b02171400/0x57f6d4e926aeedb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeedab expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.313204:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa6da000/0x57f6d4e926aeedf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeedf1 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.313212:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.313250:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa6da000/0x57f6d4e926aeedf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeedf1 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.313265:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889afa6da000/0x57f6d4e926aeedf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeedf1 expref: 16 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837616.313293:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3345180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875732036885760:0@lo:104: 00000100:00100000:3.0:1788837616.313328:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837616.313377:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889b02171400/0x57f6d4e926aeedb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeedab expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.313385:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889b02171400/0x57f6d4e926aeedb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeedab expref: 16 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837616.313394:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3347100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875732036885888:0@lo:104: 00000100:00100000:3.0:1788837616.313415:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837616.313433:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad08250c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837616.313451:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036885760 00000100:00100000:3.0:1788837616.313458:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036885760 00000100:00100000:3.0:1788837616.313484:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036885888 00000100:00100000:3.0:1788837616.313486:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036885888 00000100:00100000:3.0:1788837616.313494:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837616.313499:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6540:x1875732036885760:12345-0@lo:104: 00010000:00010000:3.0:1788837616.313507:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeedf8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.313555:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837616.313561:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:6540:x1875732036885760:12345-0@lo:104: Request processed in 61us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.313567:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837616.313578:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837616.313582:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6540:x1875732036885888:12345-0@lo:104: 00010000:00010000:3.0:1788837616.313587:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeedb2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.313647:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788837616.313653:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:6540:x1875732036885888:12345-0@lo:104: Request processed in 70us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837616.313659:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788837616.313675:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837616.313681:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeedf8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.313687:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db800 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837616.313691:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeedf8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.313699:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeedf8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837616.313707:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeedf8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837616.313711:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837616.313738:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeedf8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.313744:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837616.313761:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeedf8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.313767:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6db800/0x57f6d4e926aeedf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeedf8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837616.313949:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3345180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875732036885760:0@lo:104: 00000100:00100000:2.0:1788837616.313960:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3347100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6540:1875732036885888:0@lo:104: 00010000:00010000:2.0:1788837616.313979:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.314017:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837616.314021:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeedb2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.314027:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889b02171e00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837616.314030:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeedb2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.314036:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeedb2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837616.314042:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeedb2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837616.314046:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837616.314059:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeedb2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.314065:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788837616.314104:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036886144:0@lo:103: 00000100:00100000:2.0:1788837616.314134:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837616.314187:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeedb2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.314194:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889b02171e00/0x57f6d4e926aeedab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeedb2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837616.314207:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837616.314208:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837616.314210:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837616.314216:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837616.314231:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036886016:0@lo:103: 00010000:00010000:3.0:1788837616.314296:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837616.314385:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837616.314498:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036886144 00000100:00100000:0.0:1788837616.314503:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036886144 00010000:00010000:0.0:1788837616.314524:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889b02171400/0x57f6d4e926aeedb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeedab expref: 17 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837616.314545:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036886016 00000100:00100000:0.0:1788837616.314554:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036886016 00010000:00010000:0.0:1788837616.314568:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa6da000/0x57f6d4e926aeedf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeedf1 expref: 18 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837616.314587:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788837616.314594:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:3650:x1875732036886144:12345-0@lo:103: 00010000:00010000:0.0:1788837616.314618:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837616.314623:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889b02171400/0x57f6d4e926aeedb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeedab expref: 18 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.314632:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889b02171400/0x57f6d4e926aeedb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeedab expref: 18 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.314644:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889b02171400/0x57f6d4e926aeedb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeedab expref: 18 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.314656:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837616.314694:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:3650:x1875732036886144:12345-0@lo:103: Request processed in 100us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837616.314701:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788837616.314715:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788837616.314720:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:3649:x1875732036886016:12345-0@lo:103: 00010000:00010000:0.0:1788837616.314728:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837616.314733:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa6da000/0x57f6d4e926aeedf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeedf1 expref: 16 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.314741:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa6da000/0x57f6d4e926aeedf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeedf1 expref: 16 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.314751:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6da000/0x57f6d4e926aeedf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeedf1 expref: 16 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.314766:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.314799:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788837616.314880:0:6510:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015886511s 00010000:00010000:0.0:1788837616.314885:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.314891:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.314898:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.314904:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.314909:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837616.314913:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.314919:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.314934:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.314943:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837616.314975:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:3649:x1875732036886016:12345-0@lo:103: Request processed in 254us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837616.314982:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788837616.315003:0:6540:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.315010:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837616.315015:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b17c00/0x57f6d4e926aeeebc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837616.315092:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036886016:0@lo:103: 00000100:00100000:3.0:1788837616.315114:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036886144:0@lo:103: 00000100:00100000:0.0:1788837616.316073:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9517:1875732036885632:0@lo:253: 10000000:01000000:0.0:1788837616.316086:0:9517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788837616.316090:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788837616.316092:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788837616.316093:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837616.316094:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837616.316095:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837616.316096:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837616.316098:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837616.316099:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788837616.316101:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788837616.316102:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837616.316103:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788837616.316115:0:9517:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788837616.322708:0:9517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788837616.323107:0:9517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788837616.323331:0:9517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788837616.323477:0:9517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788837616.324090:0:9517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788837616.324284:0:9517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788837616.326266:0:9517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788837616.336001:0:9517:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788837616.336011:0:9517:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788837616.336048:0:9517:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788837616.336095:0:9517:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788837616.336118:0:9517:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788837616.336146:0:9517:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788837616.338065:0:9517:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788837616.338266:0:9517:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:2.0:1788837617.300182:0:9590:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788837617.300449:0:9590:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788837617.337961:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837618.108403:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036886400:0@lo:13: 00000100:00100000:2.0:1788837618.108469:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837618.108543:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036886400 00000100:00100000:2.0:1788837618.108550:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036886400 00000100:00100000:2.0:1788837618.108618:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788837618.108627:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036886400:12345-0@lo:13: 00002000:00000024:2.0:1788837618.108674:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837618.108721:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036886400:12345-0@lo:13: Request processed in 94us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837618.108727:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788837618.108747:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837618.108799:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27bd180 x1875732036886400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837618.108817:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036886400:0@lo:13: 00000100:00100000:2.0:1788837618.108976:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036886272:0@lo:13: 00000100:00100000:2.0:1788837618.109008:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837618.109041:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036886272 00000100:00100000:2.0:1788837618.109045:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036886272 00000100:00100000:2.0:1788837618.109076:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788837618.109082:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036886272:12345-0@lo:13: 00002000:00000024:2.0:1788837618.109092:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837618.109121:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036886272:12345-0@lo:13: Request processed in 39us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837618.109128:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788837618.109142:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837618.109159:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2512680 x1875732036886272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837618.109172:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036886272:0@lo:13: 00010000:00010000:0.0:1788837618.371751:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837619.386048:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837619.646274:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036886528:0@lo:41: 00000100:00100000:2.0:1788837619.646352:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837619.646595:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036886528 00000100:00100000:0.0:1788837619.646604:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036886528 00000100:00100000:0.0:1788837619.646655:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788837619.646664:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036886528:12345-0@lo:41: 00000004:00000024:0.0:1788837619.646698:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788837619.646764:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036886528:12345-0@lo:41: Request processed in 101us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837619.646809:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788837619.646994:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036886528:0@lo:41: 00010000:00010000:0.0:1788837620.410961:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837620.664960:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837620.664986:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036886656:0@lo:41: 00000100:00100000:3.0:1788837620.665172:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837620.665288:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036886656 00000100:00100000:2.0:1788837620.665298:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036886656 00000100:00100000:2.0:1788837620.665365:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788837620.665374:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036886656:12345-0@lo:41: 00000004:00000024:2.0:1788837620.665409:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788837620.665462:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036886656:12345-0@lo:41: Request processed in 88us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837620.665469:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788837620.665563:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036886656:0@lo:41: 00010000:00010000:3.0:1788837621.432886:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837621.695532:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036886784:0@lo:400: 00000100:00100000:1.0:1788837621.695616:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837621.695660:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036887296:0@lo:400: 00000100:00100000:1.0:1788837621.695683:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837621.695699:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036887808:0@lo:400: 00000100:00100000:1.0:1788837621.696044:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837621.696089:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788837621.696096:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732036887168:0@lo:400: 00000100:00100000:1.0:1788837621.696124:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837621.696143:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036887680:0@lo:400: 00000100:00100000:1.0:1788837621.696164:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837621.696194:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036886912:0@lo:400: 00000100:00100000:1.0:1788837621.696215:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837621.696229:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036887424:0@lo:400: 00000100:00100000:1.0:1788837621.696246:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837621.696259:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036887936:0@lo:400: 00000100:00100000:1.0:1788837621.696275:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837621.696289:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788837621.696294:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036887040:0@lo:400: 00000100:00100000:1.0:1788837621.696311:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837621.696326:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036887552:0@lo:400: 00000100:00100000:1.0:1788837621.696342:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837621.696350:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036888064:0@lo:400: 00000100:00100000:1.0:1788837621.696368:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837621.696460:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036886784 00000100:00100000:1.0:1788837621.696468:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036886784 00000100:00100000:1.0:1788837621.696523:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788837621.696532:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:3651:x1875732036886784:12345-0@lo:400: 00000100:00100000:1.0:1788837621.696650:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:3651:x1875732036886784:12345-0@lo:400: Request processed in 119us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837621.696658:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788837621.696691:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036887296 00000100:00100000:1.0:1788837621.696701:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036887296 00000100:00100000:1.0:1788837621.696815:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036887040 00000100:00100000:1.0:1788837621.696820:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036887040 00000100:00100000:1.0:1788837621.696837:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788837621.696843:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036887296:12345-0@lo:400: 00000100:00100000:1.0:1788837621.696881:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036887296:12345-0@lo:400: Request processed in 38us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837621.696887:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788837621.696902:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788837621.696908:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036887040:12345-0@lo:400: 00000100:00100000:1.0:1788837621.696940:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036887040:12345-0@lo:400: Request processed in 33us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837621.696946:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788837621.696965:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036887808 00000100:00100000:1.0:1788837621.696968:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036887808 00000100:00100000:1.0:1788837621.697000:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036887680 00000100:00100000:1.0:1788837621.697004:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036887680 00000100:00100000:1.0:1788837621.697023:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837621.697030:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036887808:12345-0@lo:400: 00000100:00100000:1.0:1788837621.697060:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036887808:12345-0@lo:400: Request processed in 31us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837621.697066:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837621.697077:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788837621.697083:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036887680:12345-0@lo:400: 00000100:00100000:1.0:1788837621.697108:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036887680:12345-0@lo:400: Request processed in 26us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837621.697114:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788837621.697135:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036887168 00000100:00100000:1.0:1788837621.697146:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036887168 00000100:00100000:1.0:1788837621.697165:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036886912 00000100:00100000:1.0:1788837621.697168:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036886912 00000100:00100000:1.0:1788837621.697177:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036887424 00000100:00100000:1.0:1788837621.697179:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036887424 00000100:00100000:1.0:1788837621.697190:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036887936 00000100:00100000:1.0:1788837621.697192:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036887936 00000100:00100000:1.0:1788837621.697201:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036887552 00000100:00100000:1.0:1788837621.697203:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036887552 00000100:00100000:1.0:1788837621.697214:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036888064 00000100:00100000:1.0:1788837621.697216:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036888064 00000100:00100000:1.0:1788837621.697227:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788837621.697233:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732036887168:12345-0@lo:400: 00000100:00100000:1.0:1788837621.697263:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732036887168:12345-0@lo:400: Request processed in 31us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837621.697269:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788837621.697279:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788837621.697284:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036886912:12345-0@lo:400: 00000100:00100000:1.0:1788837621.697304:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036886912:12345-0@lo:400: Request processed in 21us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837621.697309:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788837621.697318:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788837621.697323:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036887424:12345-0@lo:400: 00000100:00100000:1.0:1788837621.697346:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036887424:12345-0@lo:400: Request processed in 23us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837621.697351:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788837621.697360:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788837621.697365:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036887936:12345-0@lo:400: 00000100:00100000:0.0:1788837621.698194:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036887040:0@lo:400: 00010000:00080000:0.0:1788837621.698207:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2513b80 x1875732036886912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837621.698215:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036886912:0@lo:400: 00010000:00080000:0.0:1788837621.698225:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2511f80 x1875732036887424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837621.698230:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036887424:0@lo:400: 00010000:00080000:0.0:1788837621.698256:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2513480 x1875732036887168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837621.698262:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732036887168:0@lo:400: 00010000:00080000:0.0:1788837621.698269:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2510a80 x1875732036887680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837621.698273:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036887680:0@lo:400: 00000100:00100000:0.0:1788837621.698280:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036886784:0@lo:400: 00000100:00100000:0.0:1788837621.698285:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036887296:0@lo:400: 00010000:00080000:0.0:1788837621.698292:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2512300 x1875732036887808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837621.698296:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036887808:0@lo:400: 00000100:00100000:3.0:1788837621.698351:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788837621.698361:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036887552:12345-0@lo:400: 00000100:00100000:3.0:1788837621.698420:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036887552:12345-0@lo:400: Request processed in 63us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837621.698425:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788837621.698437:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788837621.698451:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036888064:12345-0@lo:400: 00000100:00100000:3.0:1788837621.698472:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036888064:12345-0@lo:400: Request processed in 22us (2103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837621.698475:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788837621.698577:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036887936:12345-0@lo:400: Request processed in 1210us (2299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837621.698591:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788837621.698610:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837621.698615:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837621.698618:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837621.698672:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2512a00 x1875732036887552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837621.698695:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2512a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036887552:0@lo:400: 00010000:00080000:0.0:1788837621.698712:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2513100 x1875732036888064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837621.698818:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036888064:0@lo:400: 00010000:00080000:0.0:1788837621.698831:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2511180 x1875732036887936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837621.698904:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036887936:0@lo:400: 00010000:00010000:0.0:1788837622.456911:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788837623.037977:0:9879:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788837623.225223:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837623.225247:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036888192:0@lo:13: 00000100:00100000:0.0:1788837623.225316:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837623.225377:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036888192 00000100:00100000:0.0:1788837623.225385:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036888192 00000100:00100000:0.0:1788837623.225436:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837623.225446:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036888192:12345-0@lo:13: 00002000:00000024:0.0:1788837623.225472:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837623.225527:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036888192:12345-0@lo:13: Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837623.225534:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788837623.225587:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2652680 x1875732036888192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837623.225607:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036888192:0@lo:13: 00000100:00080000:0.0:1788837623.225647:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837623.234014:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036888320:0@lo:13: 00000100:00100000:0.0:1788837623.234112:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837623.234337:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036888320 00000100:00100000:1.0:1788837623.234346:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036888320 00000100:00100000:1.0:1788837623.234410:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788837623.234419:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036888320:12345-0@lo:13: 00002000:00000024:1.0:1788837623.234442:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837623.234500:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036888320:12345-0@lo:13: Request processed in 81us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837623.234507:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788837623.234549:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa736300 x1875732036888320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837623.234570:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036888320:0@lo:13: 00000100:00080000:0.0:1788837623.235047:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788837623.482406:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788837624.002383:0:9932:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788837624.004140:0:9932:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788837624.505170:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788837624.761084:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788837624.761090:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889afa550800 from 39 10000000:01000000:3.0:1788837624.761095:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788837624.761134:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.761143:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.761151:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837624.761169:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036888448:0@lo:101: 00000100:00100000:3.0:1788837624.761229:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837624.761291:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2597000 going to sleep for 11 seconds 00000100:00100000:2.0:1788837624.761354:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036888448 00000100:00100000:2.0:1788837624.761361:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036888448 00000100:00100000:2.0:1788837624.761405:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788837624.761411:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036888448:12345-0@lo:101: 00010000:00010000:2.0:1788837624.761422:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837624.761433:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeeeca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeec3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.761451:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeeeca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeec3 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.761472:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeeeca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeec3 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.761479:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6da600, rc 0) 00000100:00100000:2.0:1788837624.761516:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036888448:12345-0@lo:101: Request processed in 105us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837624.761520:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788837624.761665:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036888576:0@lo:41: 00000100:00100000:1.0:1788837624.761691:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.761769:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036888576 00000100:00100000:0.0:1788837624.761772:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036888576 00000100:00100000:0.0:1788837624.761814:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788837624.761818:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036888576:12345-0@lo:41: 00000004:00000024:0.0:1788837624.761839:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788837624.761886:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036888576:12345-0@lo:41: Request processed in 67us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837624.761892:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788837624.761962:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036888576:0@lo:41: 00000100:00100000:3.0:1788837624.762050:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036888448:0@lo:101: 00010000:00010000:3.0:1788837624.762060:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeeca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.762067:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeeca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837624.762105:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036888704:0@lo:501: 00000100:00100000:3.0:1788837624.762136:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837624.762160:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2597000 going to sleep for 11 seconds 00000100:00100000:1.0:1788837624.762196:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036888704 00000100:00100000:1.0:1788837624.762200:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036888704 00000100:00100000:1.0:1788837624.762225:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788837624.762229:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036888704:12345-0@lo:501: 00000100:00100000:1.0:1788837624.762345:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036888704:12345-0@lo:501: Request processed in 114us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.762352:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788837624.762430:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036888704:0@lo:501: 00000100:00100000:3.0:1788837624.762448:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036888832:0@lo:503: 00000100:00100000:3.0:1788837624.762495:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837624.762517:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2597000 going to sleep for 11 seconds 00000100:00100000:1.0:1788837624.762564:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036888832 00000100:00100000:1.0:1788837624.762574:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036888832 00000100:00100000:1.0:1788837624.762600:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788837624.762607:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036888832:12345-0@lo:503: 00000100:00100000:1.0:1788837624.762690:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036888832:12345-0@lo:503: Request processed in 83us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.762697:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788837624.762811:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036888832:0@lo:503: 00000100:00100000:0.0:1788837624.763577:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2651f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9984:1875732036888960:0@lo:502: 00000100:00100000:0.0:1788837624.763622:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.763737:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c254b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788837624.763794:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036888960 00000100:00100000:2.0:1788837624.763800:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036888960 00000100:00100000:2.0:1788837624.763877:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788837624.763885:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9984:x1875732036888960:12345-0@lo:502: 00000100:00100000:2.0:1788837624.763986:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9984:x1875732036888960:12345-0@lo:502: Request processed in 101us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837624.763993:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788837624.764072:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2651f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9984:1875732036888960:0@lo:502: 00000100:00100000:0.0:1788837624.764112:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2651f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9984:1875732036889088:0@lo:502: 00000100:00100000:0.0:1788837624.764146:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.764298:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c254b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788837624.764379:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036889088 00000100:00100000:1.0:1788837624.764383:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036889088 00000100:00100000:1.0:1788837624.764405:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788837624.764410:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9984:x1875732036889088:12345-0@lo:502: 00000100:00100000:1.0:1788837624.764498:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:9984:x1875732036889088:12345-0@lo:502: Request processed in 86us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.764504:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788837624.764582:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2651f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9984:1875732036889088:0@lo:502: 00000040:00080000:0.0:1788837624.764602:0:9984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788837624.764865:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788837624.764887:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788837624.764896:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeeca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837624.764906:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeeca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837624.764915:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788837624.764917:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788837624.764920:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788837624.764943:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837624.764951:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837624.764971:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837624.764985:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036889216:0@lo:101: 00000100:00100000:1.0:1788837624.765014:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.765051:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa520600 going to sleep for 11 seconds 00000100:00100000:0.0:1788837624.765144:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036889216 00000100:00100000:0.0:1788837624.765149:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036889216 00000100:00100000:0.0:1788837624.765168:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788837624.765174:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036889216:12345-0@lo:101: 00010000:00010000:0.0:1788837624.765182:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837624.765194:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac0030200/0x57f6d4e926aeeed8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeed1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.765220:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac0030200/0x57f6d4e926aeeed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeed1 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.765229:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac0030200/0x57f6d4e926aeeed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeed1 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.765237:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0030200, rc 0) 00000100:00100000:0.0:1788837624.765275:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036889216:12345-0@lo:101: Request processed in 100us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837624.765281:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788837624.765390:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036889216:0@lo:101: 00010000:00010000:1.0:1788837624.765402:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeed8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837624.765410:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeed8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837624.765464:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036889344:0@lo:501: 00000100:00100000:1.0:1788837624.765490:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.765510:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa520600 going to sleep for 11 seconds 00000100:00100000:0.0:1788837624.765551:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036889344 00000100:00100000:0.0:1788837624.765556:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036889344 00000100:00100000:0.0:1788837624.765573:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788837624.765578:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036889344:12345-0@lo:501: 00000100:00100000:0.0:1788837624.765690:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036889344:12345-0@lo:501: Request processed in 110us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837624.765697:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788837624.765819:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036889344:0@lo:501: 00000100:00100000:1.0:1788837624.765843:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036889472:0@lo:503: 00000100:00100000:1.0:1788837624.765881:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.765901:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa520600 going to sleep for 11 seconds 00000100:00100000:0.0:1788837624.765972:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036889472 00000100:00100000:0.0:1788837624.765976:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036889472 00000100:00100000:0.0:1788837624.765993:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788837624.765998:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036889472:12345-0@lo:503: 00000100:00100000:0.0:1788837624.766074:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036889472:12345-0@lo:503: Request processed in 75us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837624.766080:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788837624.766206:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036889472:0@lo:503: 00000100:00100000:1.0:1788837624.766654:0:9985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9985:1875732036889600:0@lo:502: 00000100:00100000:1.0:1788837624.766763:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.766876:0:9985:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837624.767144:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036889600 00000100:00100000:3.0:1788837624.767149:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036889600 00000100:00100000:0.0:1788837624.767195:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788837624.767203:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9985:x1875732036889600:12345-0@lo:502: 00000100:00100000:0.0:1788837624.767308:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9985:x1875732036889600:12345-0@lo:502: Request processed in 105us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837624.767314:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788837624.767450:0:9985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9985:1875732036889600:0@lo:502: 00000020:01000000:1.0:1788837624.767489:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837624.767497:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837624.767500:0:9985:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788837624.767505:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788837624.767507:0:9985:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788837624.767526:0:9985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9985:1875732036889728:0@lo:502: 00000100:00100000:1.0:1788837624.767562:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.767657:0:9985:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837624.767880:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036889728 00000100:00100000:2.0:1788837624.767886:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036889728 00000100:00100000:2.0:1788837624.767911:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788837624.767919:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9985:x1875732036889728:12345-0@lo:502: 00000100:00100000:2.0:1788837624.768005:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:9985:x1875732036889728:12345-0@lo:502: Request processed in 87us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837624.768012:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788837624.768156:0:9985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9985:1875732036889728:0@lo:502: 00000020:01000000:1.0:1788837624.768175:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837624.768179:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837624.768181:0:9985:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788837624.768185:0:9985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788837624.768364:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788837624.768383:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788837624.768392:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeed8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.768401:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeed8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837624.768411:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788837624.768414:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ae7d4b000 from 39 10000000:01000000:2.0:1788837624.768416:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788837624.768439:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.768447:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.768476:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837624.768489:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036889856:0@lo:101: 00000100:00100000:2.0:1788837624.768520:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837624.768583:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837624.768633:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036889856 00000100:00100000:3.0:1788837624.768637:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036889856 00000100:00100000:0.0:1788837624.768745:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788837624.768755:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036889856:12345-0@lo:101: 00010000:00010000:0.0:1788837624.768764:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837624.768804:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac0031e00/0x57f6d4e926aeeee6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeedf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.768825:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac0031e00/0x57f6d4e926aeeee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeedf expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.768835:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac0031e00/0x57f6d4e926aeeee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeedf expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.768843:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0031e00, rc 0) 00000100:00100000:0.0:1788837624.768872:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036889856:12345-0@lo:101: Request processed in 119us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837624.768878:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788837624.768935:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036889856:0@lo:101: 00010000:00010000:2.0:1788837624.768947:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeee6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.768956:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeee6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837624.769001:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036889984:0@lo:501: 00000100:00100000:2.0:1788837624.769025:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837624.769249:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837624.769281:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036889984 00000100:00100000:1.0:1788837624.769286:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036889984 00000100:00100000:1.0:1788837624.769307:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788837624.769313:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036889984:12345-0@lo:501: 00000100:00100000:1.0:1788837624.769422:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036889984:12345-0@lo:501: Request processed in 108us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.769428:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788837624.769497:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036889984:0@lo:501: 00000100:00100000:2.0:1788837624.769524:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036890112:0@lo:503: 00000100:00100000:2.0:1788837624.769562:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837624.769581:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837624.769625:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036890112 00000100:00100000:1.0:1788837624.769629:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036890112 00000100:00100000:1.0:1788837624.769646:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788837624.769651:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036890112:12345-0@lo:503: 00000100:00100000:1.0:1788837624.769898:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036890112:12345-0@lo:503: Request processed in 246us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.769904:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788837624.770108:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036890112:0@lo:503: 00000100:00100000:1.0:1788837624.770470:0:9986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9986:1875732036890240:0@lo:502: 00000100:00100000:1.0:1788837624.770513:0:9986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.770576:0:9986:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788837624.770607:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036890240 00000100:00100000:2.0:1788837624.770612:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036890240 00000100:00100000:2.0:1788837624.770744:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788837624.770752:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:9986:x1875732036890240:12345-0@lo:502: 00000100:00100000:2.0:1788837624.771127:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:9986:x1875732036890240:12345-0@lo:502: Request processed in 375us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837624.771135:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788837624.771203:0:9986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9986:1875732036890240:0@lo:502: 00000100:00100000:1.0:1788837624.771246:0:9986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9986:1875732036890368:0@lo:502: 00000100:00100000:1.0:1788837624.771278:0:9986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.771446:0:9986:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788837624.771517:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036890368 00000100:00100000:3.0:1788837624.771523:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036890368 00000100:00100000:3.0:1788837624.771547:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788837624.771554:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:9986:x1875732036890368:12345-0@lo:502: 00000100:00100000:3.0:1788837624.771637:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:9986:x1875732036890368:12345-0@lo:502: Request processed in 83us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837624.771644:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788837624.771760:0:9986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9986:1875732036890368:0@lo:502: 00000040:00080000:1.0:1788837624.771796:0:9986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788837624.772003:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788837624.772023:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788837624.772032:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeee6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.772153:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeee6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837624.772163:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788837624.772165:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ae7d4b000 from 6 10000000:01000000:2.0:1788837624.772168:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788837624.772195:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.772204:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.772213:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837624.772226:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036890496:0@lo:101: 00000100:00100000:2.0:1788837624.772258:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837624.772328:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae306c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837624.772416:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036890496 00000100:00100000:0.0:1788837624.772421:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036890496 00000100:00100000:3.0:1788837624.772511:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788837624.772520:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036890496:12345-0@lo:101: 00010000:00010000:3.0:1788837624.772530:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837624.772542:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b17200/0x57f6d4e926aeeef4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeeed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.772563:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17200/0x57f6d4e926aeeef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeeed expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.772573:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b17200/0x57f6d4e926aeeef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeeed expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.772596:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17200, rc 0) 00000100:00100000:3.0:1788837624.772637:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:6521:x1875732036890496:12345-0@lo:101: Request processed in 118us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837624.772643:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788837624.772756:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036890496:0@lo:101: 00010000:00010000:2.0:1788837624.772768:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.772812:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837624.772845:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036890624:0@lo:256: 00000100:00100000:2.0:1788837624.772869:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837624.772882:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae306c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837624.772962:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036890624 00000100:00100000:1.0:1788837624.772967:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036890624 00000100:00100000:1.0:1788837624.772989:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788837624.772996:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:6521:x1875732036890624:12345-0@lo:256: 20000000:01000000:1.0:1788837624.773009:0:6519:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788837624.773026:0:6519:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788837624.773029:0:6519:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788837624.773114:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:6521:x1875732036890624:12345-0@lo:256: Request processed in 119us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.773119:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788837624.773252:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036890624:0@lo:256: 10000000:01000000:2.0:1788837624.773289:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788837624.773295:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.773303:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837624.773310:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788837624.773312:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788837624.773315:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788837624.773330:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.773337:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.773345:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837624.773356:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036890752:0@lo:101: 00000100:00100000:2.0:1788837624.773389:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837624.773419:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae306c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837624.773475:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036890752 00000100:00100000:3.0:1788837624.773480:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036890752 00000100:00100000:3.0:1788837624.773509:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788837624.773513:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:6521:x1875732036890752:12345-0@lo:101: 00010000:00010000:3.0:1788837624.773518:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837624.773525:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b17600/0x57f6d4e926aeef02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeefb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.773538:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17600/0x57f6d4e926aeef02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeefb expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.773546:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b17600/0x57f6d4e926aeef02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeefb expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.773553:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17600, rc 0) 00000100:00100000:3.0:1788837624.773580:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036890752:12345-0@lo:101: Request processed in 66us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837624.773586:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788837624.773654:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036890752:0@lo:101: 00010000:00010000:2.0:1788837624.773733:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef02 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837624.773742:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeef02 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837624.773818:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036890880:0@lo:501: 00000100:00100000:2.0:1788837624.773842:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837624.773853:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae306c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837624.773902:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036890880 00000100:00100000:3.0:1788837624.773906:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036890880 00000100:00100000:3.0:1788837624.773936:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788837624.773942:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036890880:12345-0@lo:501: 00000100:00100000:3.0:1788837624.774025:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036890880:12345-0@lo:501: Request processed in 83us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837624.774093:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788837624.774147:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036890880:0@lo:501: 00000100:00100000:2.0:1788837624.774165:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036891008:0@lo:503: 00000100:00100000:2.0:1788837624.774192:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837624.774212:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae306c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837624.774307:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036891008 00000100:00100000:3.0:1788837624.774311:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036891008 00000100:00100000:3.0:1788837624.774331:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788837624.774336:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036891008:12345-0@lo:503: 00000100:00100000:3.0:1788837624.774418:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036891008:12345-0@lo:503: Request processed in 80us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837624.774424:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788837624.774538:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036891008:0@lo:503: 00000100:00100000:3.0:1788837624.775219:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9987:1875732036891136:0@lo:502: 00000100:00100000:3.0:1788837624.775261:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837624.775292:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837624.775339:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036891136 00000100:00100000:1.0:1788837624.775344:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036891136 00000100:00100000:1.0:1788837624.775378:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788837624.775385:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:9987:x1875732036891136:12345-0@lo:502: 00000100:00100000:1.0:1788837624.775494:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:9987:x1875732036891136:12345-0@lo:502: Request processed in 109us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.775500:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788837624.775617:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9987:1875732036891136:0@lo:502: 00000020:01000000:3.0:1788837624.775639:0:9987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788837624.775645:0:9987:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788837624.775652:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837624.775654:0:9987:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788837624.775658:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788837624.775732:0:9987:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:3.0:1788837624.775754:0:9987:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788837624.775757:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788837624.775772:0:9987:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff889afc3fcd28) 00000020:00000080:3.0:1788837624.775833:0:9987:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788837624.775840:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788837624.775917:0:9987:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788837624.775923:0:9987:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788837624.775930:0:9987:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926aeef10 00010000:00080000:3.0:1788837624.775969:0:9987:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889affb24000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788837624.776350:0:9987:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788837624.776487:0:9987:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788837624.776498:0:9987:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788837624.776922:0:9987:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788837624.777028:0:9987:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788837624.777215:0:9987:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788837624.777291:0:9987:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788837624.777752:0:9988:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837624.777758:0:9988:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788837624.778739:0:9987:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788837624.778751:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788837624.779102:0:9987:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788837624.779128:0:9987:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926aeef17 00000100:00080000:2.0:1788837624.779138:0:9987:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837624.779143:0:9987:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff889affb24000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837624.779174:0:9987:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c27bdc00 x1875732036891264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837624.779230:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732036891264:0@lo:8: 00000100:00100000:3.0:1788837624.779296:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.779378:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036891264 00000100:00100000:1.0:1788837624.779385:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036891264 00000100:00100000:1.0:1788837624.779428:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837624.779435:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875732036891264:12345-0@lo:8: 00010000:00080000:1.0:1788837624.779470:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:1.0:1788837624.779494:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926aeef1e 00002000:00100000:1.0:1788837624.779508:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8899c321c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788837624.779512:0:8441:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1788837624.779516:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788837624.779575:0:8441:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1788837624.779735:0:9987:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788837624.779834:0:9987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837624.779852:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837624.779854:0:9987:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788837624.779858:0:9987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837624.779862:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837624.779864:0:9987:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788837624.779867:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788837624.779869:0:9987:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788837624.779893:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9987:1875732036891392:0@lo:502: 00000100:00100000:2.0:1788837624.779946:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837624.779972:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036891392 00000100:00100000:2.0:1788837624.779977:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036891392 00000100:00100000:2.0:1788837624.780008:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788837624.780016:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:9987:x1875732036891392:12345-0@lo:502: 00000100:00100000:2.0:1788837624.780207:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:9987:x1875732036891392:12345-0@lo:502: Request processed in 190us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837624.780214:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788837624.780254:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae30840 going to sleep for 11 seconds 00000100:00100000:2.0:1788837624.780274:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9987:1875732036891392:0@lo:502: 00000020:01000000:2.0:1788837624.780298:0:9987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837624.780302:0:9987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837624.780303:0:9987:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788837624.780307:0:9987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00002000:00080000:1.0:1788837624.780624:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788837624.780649:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8899c321f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837624.780976:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1875732036891264:12345-0@lo:8: Request processed in 1539us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.780984:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788837624.781293:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036891520:0@lo:400: 00000100:00100000:2.0:1788837624.781331:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.781405:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036891520 00000100:00100000:0.0:1788837624.781411:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036891520 00000100:00100000:0.0:1788837624.781465:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837624.781475:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036891520:12345-0@lo:400: 00000100:00100000:0.0:1788837624.781520:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036891520:12345-0@lo:400: Request processed in 47us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837624.781536:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788837624.781568:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa734e00 x1875732036891520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837624.781582:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036891520:0@lo:400: 00000100:00100000:1.0:1788837624.781835:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036891648:0@lo:400: 00000100:00100000:1.0:1788837624.781869:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.781890:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036892160:0@lo:400: 00000100:00100000:1.0:1788837624.781911:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.781930:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788837624.781936:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036891776:0@lo:400: 00000100:00100000:1.0:1788837624.781959:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.781976:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036892288:0@lo:400: 00000100:00100000:1.0:1788837624.781995:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.782021:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036891648 00000100:00100000:1.0:1788837624.782026:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036891648 00000100:00100000:0.0:1788837624.782147:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036891904:0@lo:400: 00000100:00100000:0.0:1788837624.782173:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.782193:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036892416:0@lo:400: 00000100:00100000:0.0:1788837624.782211:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.782226:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788837624.782231:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036892032:0@lo:400: 00000100:00100000:0.0:1788837624.782250:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.782260:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036892544:0@lo:400: 00000100:00100000:0.0:1788837624.782278:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.782295:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036891776 00000100:00100000:0.0:1788837624.782298:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036891776 00000100:00100000:0.0:1788837624.782315:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036891904 00000100:00100000:0.0:1788837624.782317:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036891904 00000100:00100000:0.0:1788837624.782337:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036892416 00000100:00100000:0.0:1788837624.782340:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036892416 00000100:00100000:0.0:1788837624.782351:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036892032 00000100:00100000:0.0:1788837624.782353:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036892032 00000100:00100000:0.0:1788837624.782362:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036892544 00000100:00100000:0.0:1788837624.782364:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036892544 00000100:00100000:0.0:1788837624.782377:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837624.782383:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036891776:12345-0@lo:400: 00000100:00100000:0.0:1788837624.782420:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036891776:12345-0@lo:400: Request processed in 37us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837624.782438:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837624.782452:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788837624.782470:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036891904:12345-0@lo:400: 00000100:00100000:0.0:1788837624.782503:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036891904:12345-0@lo:400: Request processed in 34us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837624.782509:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788837624.782520:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788837624.782526:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036892416:12345-0@lo:400: 00000100:00100000:0.0:1788837624.782551:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036892416:12345-0@lo:400: Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837624.782556:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788837624.782568:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788837624.782575:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036892032:12345-0@lo:400: 00000100:00100000:0.0:1788837624.782600:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036892032:12345-0@lo:400: Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837624.782607:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788837624.782617:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788837624.782623:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036892544:12345-0@lo:400: 00000100:00100000:0.0:1788837624.782648:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036892544:12345-0@lo:400: Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837624.782654:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788837624.782681:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788837624.782685:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788837624.782705:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa736a00 x1875732036892032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837624.782730:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036892032:0@lo:400: 00010000:00080000:0.0:1788837624.782744:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa737480 x1875732036892544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837624.782752:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036892544:0@lo:400: 00010000:00080000:0.0:1788837624.782761:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa735500 x1875732036891904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837624.782768:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036891904:0@lo:400: 00010000:00080000:0.0:1788837624.782792:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa735f80 x1875732036892416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837624.782801:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036892416:0@lo:400: 00000100:00100000:1.0:1788837624.783101:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788837624.783112:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036891648:12345-0@lo:400: 00000100:00100000:1.0:1788837624.783140:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036891648:12345-0@lo:400: Request processed in 29us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.783144:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788837624.783158:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036892160 00000100:00100000:1.0:1788837624.783160:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036892160 00000100:00100000:1.0:1788837624.783176:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036892288 00000100:00100000:1.0:1788837624.783178:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036892288 00000100:00100000:1.0:1788837624.783187:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837624.783191:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa734e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036892160:12345-0@lo:400: 00000100:00100000:1.0:1788837624.783208:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa734e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036892160:12345-0@lo:400: Request processed in 17us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.783211:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837624.783217:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837624.783220:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036892288:12345-0@lo:400: 00000100:00100000:1.0:1788837624.783232:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036892288:12345-0@lo:400: Request processed in 12us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.783235:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788837624.783258:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa734380 x1875732036891776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837624.783264:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036891776:0@lo:400: 00010000:00080000:1.0:1788837624.783274:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa735880 x1875732036892288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837624.783282:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036892288:0@lo:400: 00000100:00100000:1.0:1788837624.783293:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036891648:0@lo:400: 00010000:00080000:1.0:1788837624.783314:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa734a80 x1875732036892160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837624.783322:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036892160:0@lo:400: 00000020:01000000:1.0:1788837624.783363:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1788837624.783392:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788837624.783402:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef02 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837624.783413:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef02 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837624.783423:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788837624.783425:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ac3ec4000 from 39 10000000:01000000:1.0:1788837624.783429:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788837624.783564:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837624.783572:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837624.783581:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837624.783595:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036892672:0@lo:101: 00000100:00100000:1.0:1788837624.783634:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788837624.783660:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27bdc00 x1875732036891264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788837634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837624.783669:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837624.783676:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788837624.783682:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788837624.783687:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788837624.783690:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889affb24000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788837624.783741:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788837624.783748:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732036891264:0@lo:8: 00000100:00100000:1.0:1788837624.783759:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b780 going to sleep for 11 seconds 00000004:00080000:1.0:1788837624.783808:0:9988:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788837624.783878:0:9988:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 241655101385ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788837624.783885:0:9988:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788837624.783886:0:9989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1875732036892800:0@lo:700: 00000100:00100000:2.0:1788837624.783918:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837624.783944:0:9989:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae30840 going to sleep for 11 seconds 00000100:00100000:1.0:1788837624.783948:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036892800 00000100:00100000:1.0:1788837624.783953:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036892800 00000100:00100000:1.0:1788837624.784003:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837624.784010:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9989:x1875732036892800:12345-0@lo:700: 00000100:00100000:1.0:1788837624.784048:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8448:1875732036892928:0@lo:700: 00000100:00100000:1.0:1788837624.784075:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.784088:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837624.784192:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036892928 00000100:00100000:2.0:1788837624.784197:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036892928 00000100:00100000:2.0:1788837624.784238:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837624.784244:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8448:x1875732036892928:12345-0@lo:700: 00000100:00080000:2.0:1788837624.784326:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837624.784396:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036892672 00000100:00100000:0.0:1788837624.784400:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036892672 00000100:00100000:0.0:1788837624.785431:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788837624.785443:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036892672:12345-0@lo:101: 00010000:00010000:0.0:1788837624.785465:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837624.785486:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeef2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeef25 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.785514:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeef2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeef25 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.785525:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeef2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeef25 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.785535:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0030e00, rc 0) 00000100:00100000:0.0:1788837624.785594:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036892672:12345-0@lo:101: Request processed in 153us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837624.785601:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788837624.785623:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036892672:0@lo:101: 00010000:00010000:1.0:1788837624.785640:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef2c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837624.785648:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeef2c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837624.785706:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036893056:0@lo:501: 00000100:00100000:1.0:1788837624.785736:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.785768:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837624.785802:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036893056 00000100:00100000:2.0:1788837624.785808:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036893056 00000100:00100000:2.0:1788837624.785841:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788837624.785848:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036893056:12345-0@lo:501: 00000100:00100000:2.0:1788837624.785963:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036893056:12345-0@lo:501: Request processed in 115us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837624.785970:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788837624.786144:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036893056:0@lo:501: 00000100:00100000:3.0:1788837624.786165:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036893184:0@lo:503: 00000100:00100000:3.0:1788837624.786195:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837624.786217:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35480 going to sleep for 11 seconds 00000100:00100000:1.0:1788837624.786225:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036893184 00000100:00100000:1.0:1788837624.786229:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036893184 00000100:00100000:1.0:1788837624.786258:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788837624.786426:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036893184:12345-0@lo:503: 00000100:00100000:1.0:1788837624.786514:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036893184:12345-0@lo:503: Request processed in 250us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.786521:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788837624.786563:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3347480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036893184:0@lo:503: 00000100:00100000:3.0:1788837624.787224:0:9990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3347480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9990:1875732036893312:0@lo:502: 00000100:00100000:3.0:1788837624.787265:0:9990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837624.787368:0:9990:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837624.787400:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036893312 00000100:00100000:1.0:1788837624.787404:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036893312 00000100:00100000:1.0:1788837624.787430:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788837624.787437:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:9990:x1875732036893312:12345-0@lo:502: 00000100:00100000:1.0:1788837624.787970:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:9990:x1875732036893312:12345-0@lo:502: Request processed in 532us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.787978:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788837624.787995:0:9990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3347480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9990:1875732036893312:0@lo:502: 00000100:00100000:3.0:1788837624.788171:0:9990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3347480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9990:1875732036893440:0@lo:502: 00000100:00100000:3.0:1788837624.788207:0:9990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837624.788277:0:9990:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35a80 going to sleep for 11 seconds 00000004:00080000:3.0:1788837624.788544:0:7456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788837624.788628:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036893440 00000100:00100000:1.0:1788837624.788633:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036893440 00000100:00100000:1.0:1788837624.788748:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788837624.788756:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:9990:x1875732036893440:12345-0@lo:502: 00000100:00100000:1.0:1788837624.788870:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:9990:x1875732036893440:12345-0@lo:502: Request processed in 115us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.788877:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788837624.788953:0:9990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3347480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9990:1875732036893440:0@lo:502: 00000040:00080000:2.0:1788837624.788975:0:9990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788837624.789219:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788837624.789240:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788837624.789251:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef2c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.789261:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef2c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837624.789270:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788837624.789273:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ac3ec4000 from 6 10000000:01000000:0.0:1788837624.789276:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788837624.789303:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.789311:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.789320:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837624.789333:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2650000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036893568:0@lo:101: 00000100:00100000:0.0:1788837624.789366:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.789536:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c254b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837624.789599:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036893568 00000100:00100000:3.0:1788837624.789605:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036893568 00000100:00100000:3.0:1788837624.789630:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788837624.789637:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036893568:12345-0@lo:101: 00010000:00010000:3.0:1788837624.789647:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837624.789822:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b17000/0x57f6d4e926aeef3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeef33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.789848:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17000/0x57f6d4e926aeef3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeef33 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.789858:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b17000/0x57f6d4e926aeef3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeef33 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.789867:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17000, rc 0) 00000100:00100000:3.0:1788837624.789901:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036893568:12345-0@lo:101: Request processed in 264us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837624.789907:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788837624.789999:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2650000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036893568:0@lo:101: 00010000:00010000:0.0:1788837624.790012:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.790045:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837624.790088:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2650000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036893696:0@lo:256: 00000100:00100000:0.0:1788837624.790120:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.790137:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c254b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837624.790248:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036893696 00000100:00100000:3.0:1788837624.790253:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036893696 00000100:00100000:3.0:1788837624.790271:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788837624.790277:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036893696:12345-0@lo:256: 20000000:01000000:3.0:1788837624.790291:0:6518:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788837624.790312:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788837624.790315:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788837624.790392:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036893696:12345-0@lo:256: Request processed in 114us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837624.790399:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788837624.790482:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2650000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036893696:0@lo:256: 10000000:01000000:0.0:1788837624.790532:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788837624.790538:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.790546:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837624.790553:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788837624.790555:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788837624.790557:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788837624.790572:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.790579:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.790586:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837624.790597:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2650000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036893824:0@lo:101: 00000100:00100000:0.0:1788837624.790625:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.790643:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac8570d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837624.790686:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036893824 00000100:00100000:3.0:1788837624.790689:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036893824 00000100:00100000:3.0:1788837624.790704:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788837624.790709:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036893824:12345-0@lo:101: 00010000:00010000:3.0:1788837624.790716:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837624.790725:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b17400/0x57f6d4e926aeef48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeef41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.790739:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17400/0x57f6d4e926aeef48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeef41 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.790747:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b17400/0x57f6d4e926aeef48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeef41 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.790754:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17400, rc 0) 00000100:00100000:3.0:1788837624.790814:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036893824:12345-0@lo:101: Request processed in 104us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837624.790820:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788837624.791072:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2650000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036893824:0@lo:101: 00010000:00010000:0.0:1788837624.791083:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef48 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837624.791091:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeef48 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837624.791135:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2650000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036893952:0@lo:501: 00000100:00100000:0.0:1788837624.791157:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.791172:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac8570d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837624.791579:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036893952 00000100:00100000:1.0:1788837624.791585:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036893952 00000100:00100000:1.0:1788837624.791793:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788837624.791800:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036893952:12345-0@lo:501: 00000100:00100000:1.0:1788837624.791919:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036893952:12345-0@lo:501: Request processed in 119us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.791925:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788837624.791955:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2650000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036893952:0@lo:501: 00000100:00100000:1.0:1788837624.791982:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036894080:0@lo:503: 00000100:00100000:1.0:1788837624.792021:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.792108:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788837624.792120:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036894080 00000100:00100000:1.0:1788837624.792123:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036894080 00000100:00100000:1.0:1788837624.792137:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788837624.792142:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036894080:12345-0@lo:503: 00000100:00100000:1.0:1788837624.792207:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036894080:12345-0@lo:503: Request processed in 64us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.792220:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788837624.792257:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036894080:0@lo:503: 00000100:00100000:1.0:1788837624.792418:0:9991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9991:1875732036894208:0@lo:502: 00000100:00100000:1.0:1788837624.792446:0:9991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837624.792575:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036894208 00000100:00100000:3.0:1788837624.792579:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036894208 00000100:00100000:3.0:1788837624.792598:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788837624.792604:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:9991:x1875732036894208:12345-0@lo:502: 00000100:00100000:1.0:1788837624.792685:0:9991:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b240 going to sleep for 11 seconds 40000000:02000000:1.0:1788837624.792905:0:6531:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1788837624.796177:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:9991:x1875732036894208:12345-0@lo:502: Request processed in 3562us (3719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837624.796210:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788837624.798891:0:9991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9991:1875732036894208:0@lo:502: 00000020:01000000:0.0:1788837624.798942:0:9991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788837624.798950:0:9991:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788837624.798960:0:9991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837624.798963:0:9991:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788837624.798972:0:9991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788837624.798977:0:9991:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:0.0:1788837624.799001:0:9991:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788837624.799004:0:9991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788837624.800328:0:9991:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8899c3648000) 00000020:00000080:0.0:1788837624.800363:0:9991:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1788837624.800375:0:9991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788837624.800490:0:9991:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788837624.800497:0:9991:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788837624.800503:0:9991:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926aeef56 00010000:00080000:0.0:1788837624.800533:0:9991:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8899c322b800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:0.0:1788837624.800756:0:9991:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1788837624.800885:0:9991:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788837624.800897:0:9991:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788837624.801160:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8448:x1875732036892928:12345-0@lo:700: Request processed in 16912us (17079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.801170:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1788837624.801468:0:9991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837624.801573:0:9991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837624.801694:0:9991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788837624.801765:0:9991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788837624.802399:0:9992:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837624.802404:0:9992:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00010000:00080000:2.0:1788837624.802712:0:8448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c31b6d80 x1875732036892928/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788837640 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837624.802728:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8448:1875732036892928:0@lo:700: 40000000:02000000:2.0:1788837624.802741:0:8448:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000001:00100000:2.0:1788837624.809343:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788837624.809884:0:9991:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837624.809897:0:9991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788837624.809937:0:9991:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788837624.809961:0:9991:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926aeef5d 00000100:00080000:0.0:1788837624.809973:0:9991:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788837624.809977:0:9991:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8899c322b800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788837624.810004:0:9991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c2653100 x1875732036894336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788837624.810018:0:9991:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788837624.810222:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732036894336:0@lo:8: 00000100:00100000:3.0:1788837624.810288:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837624.810391:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9989:x1875732036892800:12345-0@lo:700: Request processed in 26381us (26471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837624.810401:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1788837624.810475:0:9991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837624.810483:0:9991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837624.810486:0:9991:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788837624.810490:0:9991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837624.810493:0:9991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837624.810495:0:9991:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788837624.810497:0:9991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788837624.810499:0:9991:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788837624.810525:0:9991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2653800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9991:1875732036894464:0@lo:502: 00000100:00100000:0.0:1788837624.810572:0:9991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.810602:0:9991:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5605840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837624.810644:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036894464 00000100:00100000:3.0:1788837624.810650:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036894464 00000100:00100000:1.0:1788837624.810699:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036894336 00000100:00100000:3.0:1788837624.810702:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788837624.810704:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036894336 00000100:00100000:3.0:1788837624.810710:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:9991:x1875732036894464:12345-0@lo:502: 00000100:00100000:1.0:1788837624.810724:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837624.810729:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875732036894336:12345-0@lo:8: 00010000:00080000:1.0:1788837624.810750:0:8544:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:1.0:1788837624.810773:0:8544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926aeef64 00002000:00100000:1.0:1788837624.810801:0:8544:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8899c321d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788837624.810805:0:8544:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788837624.810808:0:8544:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788837624.810847:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:9991:x1875732036894464:12345-0@lo:502: Request processed in 137us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837624.810853:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00002000:00080000:1.0:1788837624.810871:0:8544:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788837624.810890:0:8544:0:(import.c:65:import_set_state_nolock()) ffff8899c321a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837624.810901:0:9991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2653800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:9991:1875732036894464:0@lo:502: 00000020:01000000:3.0:1788837624.810923:0:9991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837624.810927:0:9991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1788837624.810927:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875732036894336:12345-0@lo:8: Request processed in 197us (640us total) trans 0 rc 0/0 00000020:00000080:3.0:1788837624.810928:0:9991:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788837624.810933:0:9991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:1.0:1788837624.810934:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788837624.810974:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2653100 x1875732036894336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788837634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837624.810993:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788837624.810999:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788837624.811005:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788837624.811010:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788837624.811012:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c322b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788837624.811236:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788837624.811242:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732036894336:0@lo:8: 00000020:01000000:1.0:1788837624.811259:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 00000004:00080000:0.0:1788837624.811262:0:9992:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788837624.811313:0:9992:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 241682536401ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788837624.811320:0:9992:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 10000000:01000000:1.0:1788837624.811487:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788837624.811499:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef48 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837624.811510:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef48 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837624.811521:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788837624.811524:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff889ac85799b8 from 1 10000000:01000000:1.0:1788837624.811526:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788837624.811550:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837624.811557:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837624.811564:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837624.811578:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036894592:0@lo:101: 00000100:00100000:1.0:1788837624.811615:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.811644:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788837624.811686:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036894592 00000100:00100000:3.0:1788837624.811690:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036894592 00000100:00100000:3.0:1788837624.811717:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788837624.811724:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036894592:12345-0@lo:101: 00010000:00010000:3.0:1788837624.811734:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837624.811747:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b16600/0x57f6d4e926aeef72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeef6b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.811769:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b16600/0x57f6d4e926aeef72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeef6b expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.811810:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b16600/0x57f6d4e926aeef72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeef6b expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837624.811819:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16600, rc 0) 00000100:00100000:3.0:1788837624.811851:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036894592:12345-0@lo:101: Request processed in 127us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837624.811857:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788837624.811865:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036894592:0@lo:101: 00010000:00010000:1.0:1788837624.811876:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef72 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837624.811884:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeef72 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837624.811929:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036894720:0@lo:501: 00000100:00100000:1.0:1788837624.811964:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.811982:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b180 going to sleep for 11 seconds 00010000:00080000:2.0:1788837624.812299:0:9989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27bc700 x1875732036892800/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788837640 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837624.812310:0:9989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1875732036892800:0@lo:700: 00000100:00100000:0.0:1788837624.812609:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036894720 00000100:00100000:0.0:1788837624.812614:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036894720 00000100:00100000:0.0:1788837624.812641:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788837624.812648:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036894720:12345-0@lo:501: 00000100:00100000:0.0:1788837624.812724:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036894720:12345-0@lo:501: Request processed in 76us (759us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788837624.812731:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788837624.812746:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036894720:0@lo:501: 10000000:01000000:1.0:1788837624.812773:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788837624.812792:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef72 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837624.812800:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef72 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788837624.813424:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788837624.819377:0:9993:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788837624.819421:0:9993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9993:1875732036894976:0@lo:7: 00000100:00100000:2.0:1788837624.819498:0:9993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837624.819544:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036894976 00000100:00100000:2.0:1788837624.819551:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036894976 00000100:00100000:2.0:1788837624.819619:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788837624.819629:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9993:x1875732036894976:12345-0@lo:7: 00000100:00100000:0.0:1788837624.822739:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837624.822766:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036894848:0@lo:13: 00000100:00100000:0.0:1788837624.822870:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.823243:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036894848 00000100:00100000:1.0:1788837624.823253:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036894848 00000100:00100000:1.0:1788837624.823312:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837624.823321:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875732036894848:12345-0@lo:13: 00002000:00000024:1.0:1788837624.823362:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923828736 avail 3692306432 00000100:00100000:1.0:1788837624.823426:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875732036894848:12345-0@lo:13: Request processed in 105us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.823447:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788837624.823500:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27bc700 x1875732036894848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837624.823521:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036894848:0@lo:13: 00000004:00080000:0.0:1788837624.825092:0:9989:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788837624.825120:0:9989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2653800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1875732036895232:0@lo:7: 00000100:00100000:0.0:1788837624.825174:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.825196:0:9989:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad15a29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837624.825317:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036895232 00000100:00100000:1.0:1788837624.825322:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036895232 00000100:00100000:1.0:1788837624.825376:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788837624.825385:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9989:x1875732036895232:12345-0@lo:7: 00000100:00100000:1.0:1788837624.825439:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837624.825450:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036895104:0@lo:13: 00000100:00100000:1.0:1788837624.825491:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837624.825521:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036895104 00000100:00100000:1.0:1788837624.825525:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036895104 00000100:00100000:1.0:1788837624.825551:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788837624.825558:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875732036895104:12345-0@lo:13: 00002000:00000024:1.0:1788837624.825586:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923828736 avail 3692306432 00000100:00100000:1.0:1788837624.825625:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875732036895104:12345-0@lo:13: Request processed in 67us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.825632:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788837624.825680:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2653100 x1875732036895104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837624.825697:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036895104:0@lo:13: 00000100:00080000:3.0:1788837624.826833:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837624.826847:0:9993:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae30840 going to sleep for 11 seconds 00002000:00080000:2.0:1788837624.827758:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788837624.827764:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788837624.830648:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9993:x1875732036894976:12345-0@lo:7: Request processed in 11013us (11141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837624.830663:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00002000:00080000:1.0:1788837624.830902:0:8544:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788837624.830908:0:8544:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788837624.830978:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9989:x1875732036895232:12345-0@lo:7: Request processed in 5593us (5802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.830995:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788837624.831202:0:9989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2653800 x1875732036895232/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788837640 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837624.831216:0:9989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2653800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1875732036895232:0@lo:7: 00000004:00080000:0.0:1788837624.831229:0:9989:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788837624.831262:0:9989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2653800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1875732036895360:0@lo:5: 00000100:00100000:0.0:1788837624.831295:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.831327:0:9989:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad15a29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837624.831379:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036895360 00000100:00100000:2.0:1788837624.831386:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036895360 00000100:00100000:2.0:1788837624.831431:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837624.831439:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9989:x1875732036895360:12345-0@lo:5: 00002000:00080000:2.0:1788837624.831472:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788837624.831506:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9989:x1875732036895360:12345-0@lo:5: Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837624.831513:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788837624.831536:0:9989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2653800 x1875732036895360/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837640 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837624.831545:0:9989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2653800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1875732036895360:0@lo:5: 00000004:00080000:2.0:1788837624.831553:0:9989:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788837624.831575:0:9989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1875732036895488:0@lo:5: 00000100:00100000:2.0:1788837624.831599:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837624.831620:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036895488 00000100:00100000:2.0:1788837624.831623:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036895488 00000100:00100000:2.0:1788837624.831644:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788837624.831650:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9989:x1875732036895488:12345-0@lo:5: 00002000:00080000:2.0:1788837624.831671:0:8439:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00010000:00080000:3.0:1788837624.833096:0:9993:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27bf480 x1875732036894976/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788837640 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837624.833108:0:9993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9993:1875732036894976:0@lo:7: 00000004:00080000:3.0:1788837624.833119:0:9993:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788837624.833202:0:9993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3345f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9993:1875732036895616:0@lo:5: 00000100:00100000:3.0:1788837624.833236:0:9993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837624.833264:0:9993:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837624.833377:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036895616 00000100:00100000:0.0:1788837624.833382:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036895616 00000100:00100000:0.0:1788837624.833426:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837624.833442:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9993:x1875732036895616:12345-0@lo:5: 00002000:00080000:0.0:1788837624.833470:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788837624.833474:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788837624.834237:0:9989:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad88c1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837624.835067:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9989:x1875732036895488:12345-0@lo:5: Request processed in 3413us (3464us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788837624.835077:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000001:00080000:3.0:1788837624.838623:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1788837624.838638:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788837624.838647:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1788837624.838843:0:9989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27bdf80 x1875732036895488/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837640 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837624.838864:0:9989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9989:1875732036895488:0@lo:5: 00000004:00080000:0.0:1788837624.838879:0:9989:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788837624.838923:0:9989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2653800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9989:1875732036895744:0@lo:900: 00000100:00100000:0.0:1788837624.838983:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837624.839015:0:9989:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad15a2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788837624.839163:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036895744 00000100:00100000:1.0:1788837624.839170:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036895744 00000100:00100000:1.0:1788837624.839214:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837624.839223:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9989:x1875732036895744:12345-0@lo:900: 00000100:00100000:1.0:1788837624.839278:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9989:x1875732036895744:12345-0@lo:900: Request processed in 55us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837624.839285:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788837624.839359:0:9989:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2653800 x1875732036895744/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788837640 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837624.839369:0:9989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2653800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9989:1875732036895744:0@lo:900: 00000100:00100000:2.0:1788837624.839625:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9993:x1875732036895616:12345-0@lo:5: Request processed in 6184us (6386us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788837624.839633:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788837624.839737:0:9993:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3345f80 x1875732036895616/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837640 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837624.839746:0:9993:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788837624.839750:0:9993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3345f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9993:1875732036895616:0@lo:5: 00000004:00080000:3.0:1788837624.839759:0:9993:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788837624.839902:0:9993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3345f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9993:1875732036895872:0@lo:700: 00000100:00100000:3.0:1788837624.839948:0:9993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837624.840022:0:9993:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837624.840121:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036895872 00000100:00100000:0.0:1788837624.840126:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036895872 00000100:00100000:0.0:1788837624.840190:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837624.840199:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9993:x1875732036895872:12345-0@lo:700: 00000100:00100000:0.0:1788837624.848070:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9993:x1875732036895872:12345-0@lo:700: Request processed in 7863us (8113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837624.848086:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788837624.848592:0:9993:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3345f80 x1875732036895872/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788837640 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837624.848607:0:9993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3345f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9993:1875732036895872:0@lo:700: 00000004:02000040:2.0:1788837624.851186:0:9993:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1788837624.857001:0:9993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9993:1875732036896000:0@lo:5: 00000100:00100000:2.0:1788837624.857143:0:9993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837624.857284:0:9993:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad88c1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837624.859547:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036896000 00000100:00100000:0.0:1788837624.859557:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036896000 00000100:00100000:0.0:1788837624.859651:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837624.859668:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9993:x1875732036896000:12345-0@lo:5: 00002000:00080000:0.0:1788837624.866576:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788837624.866596:0:8441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1788837624.868493:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9993:x1875732036896000:12345-0@lo:5: Request processed in 8823us (11340us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788837624.868506:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788837624.868626:0:9993:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27bdc00 x1875732036896000/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837640 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837624.868642:0:9993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9993:1875732036896000:0@lo:5: 00000004:00080000:2.0:1788837624.868656:0:9993:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:3.0:1788837625.529073:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788837625.732109:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1788837625.785655:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036896128:0@lo:41: 00000100:00100000:3.0:1788837625.785724:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837625.786912:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036896128 00000100:00100000:1.0:1788837625.786925:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036896128 00000100:00100000:1.0:1788837625.786983:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788837625.786994:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036896128:12345-0@lo:41: 00000004:00000024:1.0:1788837625.787031:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788837625.787105:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036896128:12345-0@lo:41: Request processed in 113us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837625.787112:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788837625.787895:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036896128:0@lo:41: 00010000:00010000:0.0:1788837626.559885:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788837626.836496:0:10043:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788837626.837612:0:10043:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788837627.577869:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788837627.672462:0:10091:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788837627.672471:0:10091:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1788837627.966883:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837627.967097:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012728448 00000100:00100000:3.0:1788837627.967107:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012728448 00000100:00100000:3.0:1788837627.967153:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 181 00000100:00100000:3.0:1788837627.967160:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2392:x1875732012728448:12345-192.168.201.3@tcp:250: 00010000:00080000:3.0:1788837627.967186:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4c32a019-8b58-4c01-ad5a-2d6d487440e1@192.168.201.3@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:3.0:1788837627.967213:0:6518:0:(genops.c:1385:class_connect()) connect: client 4c32a019-8b58-4c01-ad5a-2d6d487440e1, cookie 0x57f6d4e926aeef79 00000100:00080000:3.0:1788837627.967507:0:6518:0:(import.c:65:import_set_state_nolock()) ffff8899c3642800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837627.967575:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+5:2392:x1875732012728448:12345-192.168.201.3@tcp:250: Request processed in 414us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837627.967583:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 181 00000100:00100000:3.0:1788837627.983423:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837627.983500:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012728576 00000100:00100000:0.0:1788837627.983510:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012728576 00000100:00100000:0.0:1788837627.983566:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 182 00000100:00100000:0.0:1788837627.983574:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+5:6153:x1875732012728576:12345-192.168.201.3@tcp:101: 00010000:00010000:0.0:1788837627.983588:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837627.983605:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa790a00/0x57f6d4e926aeef80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003e8c3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837627.983631:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa790a00/0x57f6d4e926aeef80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e8c3 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837627.983640:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa790a00/0x57f6d4e926aeef80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e8c3 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837627.983648:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790a00, rc 0) 00000100:00100000:0.0:1788837627.983706:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+6:6153:x1875732012728576:12345-192.168.201.3@tcp:101: Request processed in 132us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837627.983712:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 182 00000100:00100000:0.0:1788837627.987835:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837627.987990:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012728704 00000100:00100000:1.0:1788837627.988002:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012728704 00000100:00100000:1.0:1788837627.988061:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 183 00000100:00100000:1.0:1788837627.988071:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+6:6153:x1875732012728704:12345-192.168.201.3@tcp:501: 00000100:00100000:1.0:1788837627.988187:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+6:6153:x1875732012728704:12345-192.168.201.3@tcp:501: Request processed in 118us (411us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788837627.988194:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 183 00000100:00100000:2.0:1788837627.990291:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837627.990356:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012728832 00000100:00100000:0.0:1788837627.990364:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012728832 00000100:00100000:0.0:1788837627.990425:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 184 00000100:00100000:0.0:1788837627.990434:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+6:6153:x1875732012728832:12345-192.168.201.3@tcp:101: 00010000:00010000:0.0:1788837627.990464:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837627.990492:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa791200/0x57f6d4e926aeef87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003e8ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837627.990521:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa791200/0x57f6d4e926aeef87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e8ca expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837627.990533:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa791200/0x57f6d4e926aeef87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e8ca expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837627.990543:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791200, rc 0) 00000100:00100000:0.0:1788837627.990597:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+7:6153:x1875732012728832:12345-192.168.201.3@tcp:101: Request processed in 164us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837627.990605:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 184 00000100:00100000:0.0:1788837627.992625:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837627.992683:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012728960 00000100:00100000:3.0:1788837627.992691:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012728960 00000100:00100000:3.0:1788837627.992732:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 185 00000100:00100000:3.0:1788837627.992740:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+7:6153:x1875732012728960:12345-192.168.201.3@tcp:501: 00000100:00100000:2.0:1788837627.993109:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+8:6153:x1875732012728960:12345-192.168.201.3@tcp:501: Request processed in 367us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837627.993117:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 185 00000100:00100000:3.0:1788837627.994983:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837627.995045:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012729088 00000100:00100000:0.0:1788837627.995054:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012729088 00000100:00100000:0.0:1788837627.995148:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 186 00000100:00100000:0.0:1788837627.995157:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+8:6153:x1875732012729088:12345-192.168.201.3@tcp:503: 00000100:00100000:0.0:1788837627.995295:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+8:6153:x1875732012729088:12345-192.168.201.3@tcp:503: Request processed in 138us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837627.995303:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 186 00000100:00100000:0.0:1788837628.003174:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837628.003277:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012729216 00000100:00100000:2.0:1788837628.003288:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012729216 00000100:00100000:2.0:1788837628.003415:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 187 00000100:00100000:2.0:1788837628.003426:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+8:6171:x1875732012729216:12345-192.168.201.3@tcp:502: 00000100:00100000:2.0:1788837628.003578:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+8:6171:x1875732012729216:12345-192.168.201.3@tcp:502: Request processed in 154us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837628.003594:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 187 00000100:00100000:3.0:1788837628.057309:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837628.057450:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012729344 00000100:00100000:0.0:1788837628.057460:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012729344 00000100:00100000:0.0:1788837628.057518:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 188 00000100:00100000:0.0:1788837628.057527:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+8:6171:x1875732012729344:12345-192.168.201.3@tcp:502: 00000100:00100000:0.0:1788837628.057706:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+8:6171:x1875732012729344:12345-192.168.201.3@tcp:502: Request processed in 180us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837628.057714:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 188 00000100:00100000:3.0:1788837628.067186:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837628.067280:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012729472 00000100:00100000:2.0:1788837628.067288:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012729472 00000100:00100000:2.0:1788837628.067330:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 189 00000100:00100000:2.0:1788837628.067337:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+8:6153:x1875732012729472:12345-192.168.201.3@tcp:101: 00010000:00010000:2.0:1788837628.067350:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837628.067364:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6da400/0x57f6d4e926aeef8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003e8fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837628.067385:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6da400/0x57f6d4e926aeef8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e8fb expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837628.067392:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6da400/0x57f6d4e926aeef8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e8fb expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837628.067410:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6da400, rc 0) 00000100:00100000:2.0:1788837628.067506:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6153:x1875732012729472:12345-192.168.201.3@tcp:101: Request processed in 167us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837628.067513:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 189 00000100:00100000:2.0:1788837628.073673:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837628.074016:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012729600 00000100:00100000:1.0:1788837628.074026:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012729600 00000100:00100000:1.0:1788837628.074115:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 190 00000100:00100000:1.0:1788837628.074125:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6153:x1875732012729600:12345-192.168.201.3@tcp:256: 20000000:01000000:1.0:1788837628.074165:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788837628.074181:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788837628.074185:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788837628.074188:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788837628.074191:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788837628.074193:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788837628.075885:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6153:x1875732012729600:12345-192.168.201.3@tcp:256: Request processed in 1752us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837628.075900:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 190 00000100:00100000:3.0:1788837628.078558:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837628.078686:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012729728 00000100:00100000:0.0:1788837628.078697:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012729728 00000100:00100000:0.0:1788837628.078813:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 191 00000100:00100000:0.0:1788837628.078824:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6153:x1875732012729728:12345-192.168.201.3@tcp:101: 00010000:00010000:0.0:1788837628.078840:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837628.078857:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa790400/0x57f6d4e926aeef95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003e902 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837628.078886:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa790400/0x57f6d4e926aeef95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e902 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837628.078897:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa790400/0x57f6d4e926aeef95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e902 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837628.078906:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790400, rc 0) 00000100:00100000:0.0:1788837628.078972:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6153:x1875732012729728:12345-192.168.201.3@tcp:101: Request processed in 151us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837628.078979:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 191 00000100:00100000:0.0:1788837628.083986:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837628.084119:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012729856 00000100:00100000:1.0:1788837628.084128:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012729856 00000100:00100000:1.0:1788837628.084186:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 192 00000100:00100000:1.0:1788837628.084195:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6153:x1875732012729856:12345-192.168.201.3@tcp:501: 00000100:00100000:1.0:1788837628.084352:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6153:x1875732012729856:12345-192.168.201.3@tcp:501: Request processed in 157us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837628.084359:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 192 00000100:00100000:3.0:1788837628.086640:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837628.086765:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012729984 00000100:00100000:0.0:1788837628.086797:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012729984 00000100:00100000:0.0:1788837628.086855:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 193 00000100:00100000:0.0:1788837628.086864:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6153:x1875732012729984:12345-192.168.201.3@tcp:503: 00000100:00100000:0.0:1788837628.087012:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6153:x1875732012729984:12345-192.168.201.3@tcp:503: Request processed in 148us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837628.087026:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 193 00000100:00100000:3.0:1788837628.090274:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837628.090490:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012730112 00000100:00100000:2.0:1788837628.090499:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012730112 00000100:00100000:2.0:1788837628.090549:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 194 00000100:00100000:2.0:1788837628.090557:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6176:x1875732012730112:12345-192.168.201.3@tcp:502: 00000100:00100000:2.0:1788837628.090696:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6176:x1875732012730112:12345-192.168.201.3@tcp:502: Request processed in 139us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837628.090703:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 194 00000100:00100000:2.0:1788837628.092167:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837628.092242:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012730240 00000100:00100000:3.0:1788837628.092249:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012730240 00000100:00100000:3.0:1788837628.092297:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 195 00000100:00100000:3.0:1788837628.092307:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6176:x1875732012730240:12345-192.168.201.3@tcp:502: 00000100:00100000:3.0:1788837628.092442:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6176:x1875732012730240:12345-192.168.201.3@tcp:502: Request processed in 136us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837628.092451:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 195 00000100:00100000:3.0:1788837628.094629:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837628.094724:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012730368 00000100:00100000:0.0:1788837628.094732:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012730368 00000100:00100000:0.0:1788837628.094772:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:0.0:1788837628.094802:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875732012730368:12345-192.168.201.3@tcp:38: 00010000:00080000:0.0:1788837628.094830:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:0.0:1788837628.094876:0:6524:0:(genops.c:1385:class_connect()) connect: client 3a879e24-3b2f-4404-84c2-9101689d9315, cookie 0x57f6d4e926aeef9c 00000004:00100000:0.0:1788837628.094899:0:6524:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788837628.095115:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8899c322a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837628.095241:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2392:x1875732012730368:12345-192.168.201.3@tcp:38: Request processed in 438us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837628.095249:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:0.0:1788837628.096483:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837628.096536:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012730624 00000100:00100000:1.0:1788837628.096542:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012730624 00000100:00100000:1.0:1788837628.096568:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:1.0:1788837628.096574:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875732012730624:12345-192.168.201.3@tcp:38: 00010000:00080000:1.0:1788837628.096590:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1788837628.096642:0:6525:0:(genops.c:1385:class_connect()) connect: client 3a879e24-3b2f-4404-84c2-9101689d9315, cookie 0x57f6d4e926aeefa3 00000004:00100000:1.0:1788837628.096659:0:6525:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788837628.096816:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8899c321f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837628.096862:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:2392:x1875732012730624:12345-192.168.201.3@tcp:38: Request processed in 287us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837628.096873:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:0.0:1788837628.345032:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837628.345062:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036896256:0@lo:13: 00000100:00100000:0.0:1788837628.345140:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837628.345340:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837628.345351:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036896384:0@lo:13: 00000100:00100000:3.0:1788837628.345353:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036896256 00000100:00100000:3.0:1788837628.345361:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036896256 00000100:00100000:2.0:1788837628.345380:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837628.345420:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036896384 00000100:00100000:3.0:1788837628.345423:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036896384 00000100:00100000:2.0:1788837628.345425:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788837628.345433:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa734a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036896256:12345-0@lo:13: 00002000:00000024:2.0:1788837628.345462:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788837628.345503:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837628.345514:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa734a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036896256:12345-0@lo:13: Request processed in 81us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837628.345521:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788837628.345538:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788837628.345544:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036896384:12345-0@lo:13: 00002000:00000024:2.0:1788837628.345554:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837628.345589:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036896384:12345-0@lo:13: Request processed in 46us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837628.345595:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788837628.345672:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c31b7100 x1875732036896256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837628.345691:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036896256:0@lo:13: 00010000:00080000:1.0:1788837628.345763:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c31b6300 x1875732036896384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837628.345791:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036896384:0@lo:13: 00010000:00010000:0.0:1788837628.604641:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837629.100736:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837629.100873:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837629.106143:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837629.107484:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012730752 00000100:00100000:0.0:1788837629.107499:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012730752 00000100:00100000:0.0:1788837629.107592:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012730496 00000100:00100000:0.0:1788837629.107596:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012730496 00000100:00100000:0.0:1788837629.107623:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:0.0:1788837629.107631:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:0:x1875732012730752:12345-192.168.201.3@tcp:41: 00000004:00000024:0.0:1788837629.107677:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788837629.107741:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:0:x1875732012730752:12345-192.168.201.3@tcp:41: Request processed in 111us (7015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837629.107763:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:0.0:1788837629.107797:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:0.0:1788837629.107803:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:0:x1875732012730496:12345-192.168.201.3@tcp:41: 00000004:00000024:0.0:1788837629.107818:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788837629.107841:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:0:x1875732012730496:12345-192.168.201.3@tcp:41: Request processed in 38us (6968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837629.107847:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00080000:3.0:1788837629.108193:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837629.108198:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788837629.108589:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012730880 00000100:00100000:0.0:1788837629.108594:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012730880 00000100:00100000:0.0:1788837629.108630:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:0.0:1788837629.108637:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:6153:x1875732012730880:12345-192.168.201.3@tcp:41: 00000004:00000024:0.0:1788837629.108650:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788837629.108682:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:6153:x1875732012730880:12345-192.168.201.3@tcp:41: Request processed in 46us (2549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837629.108689:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:0.0:1788837629.116294:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837629.116449:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012731008 00000100:00100000:3.0:1788837629.116459:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012731008 00000100:00100000:3.0:1788837629.116521:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:3.0:1788837629.116532:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:6153:x1875732012731008:12345-192.168.201.3@tcp:40: 00000100:00100000:3.0:1788837629.116653:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:6153:x1875732012731008:12345-192.168.201.3@tcp:40: Request processed in 123us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837629.116661:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:3.0:1788837629.131979:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837629.132029:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837629.132059:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837629.132100:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837629.134475:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012731136 00000100:00100000:2.0:1788837629.134491:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012731136 00000100:00100000:2.0:1788837629.134537:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012731264 00000100:00100000:2.0:1788837629.134542:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012731264 00000100:00100000:2.0:1788837629.134566:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:2.0:1788837629.134576:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875732012731136:12345-192.168.201.3@tcp:8: 00010000:00080000:2.0:1788837629.134610:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:2.0:1788837629.134644:0:8439:0:(genops.c:1385:class_connect()) connect: client 3a879e24-3b2f-4404-84c2-9101689d9315, cookie 0x57f6d4e926aeefaa 00002000:00100000:2.0:1788837629.134669:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3a879e24-3b2f-4404-84c2-9101689d9315/ffff8899c3242000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788837629.134681:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788837629.134906:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788837629.134936:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8899c3240800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837629.135000:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2392:x1875732012731136:12345-192.168.201.3@tcp:8: Request processed in 424us (3031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837629.135008:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:2.0:1788837629.135025:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:2.0:1788837629.135029:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875732012731264:12345-192.168.201.3@tcp:8: 00010000:00080000:2.0:1788837629.135046:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:2.0:1788837629.135061:0:8439:0:(genops.c:1385:class_connect()) connect: client 3a879e24-3b2f-4404-84c2-9101689d9315, cookie 0x57f6d4e926aeefb1 00002000:00100000:2.0:1788837629.135065:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3a879e24-3b2f-4404-84c2-9101689d9315/ffff8899c3247000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788837629.135076:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788837629.135213:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788837629.135231:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8899c3245000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837629.135258:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2392:x1875732012731264:12345-192.168.201.3@tcp:8: Request processed in 226us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837629.135264:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:1.0:1788837629.135361:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012731520 00000100:00100000:1.0:1788837629.135366:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012731520 00000100:00100000:1.0:1788837629.135426:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:1.0:1788837629.135434:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3a879e24-3b2f-4404-84c2-9101689d9315+6:6153:x1875732012731520:12345-192.168.201.3@tcp:900: 00000100:00100000:1.0:1788837629.135477:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3a879e24-3b2f-4404-84c2-9101689d9315+6:6153:x1875732012731520:12345-192.168.201.3@tcp:900: Request processed in 44us (3376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837629.135484:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:1.0:1788837629.135579:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012731392 00000100:00100000:1.0:1788837629.135583:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012731392 00000100:00100000:1.0:1788837629.135612:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 196 00000100:00100000:1.0:1788837629.135619:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2395:x1875732012731392:12345-192.168.201.3@tcp:400: 00000100:00100000:1.0:1788837629.135642:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2395:x1875732012731392:12345-192.168.201.3@tcp:400: Request processed in 24us (3613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837629.135648:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 196 00000100:00100000:2.0:1788837629.152512:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837629.152633:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012731648 00000100:00100000:0.0:1788837629.152643:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012731648 00000100:00100000:0.0:1788837629.152715:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:0.0:1788837629.152726:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:6153:x1875732012731648:12345-192.168.201.3@tcp:33: 00000004:00080000:2.0:1788837629.201009:0:6527:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 44822us 00000004:00200000:1.0:1788837629.217527:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788837629.217670:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:6153:x1875732012731648:12345-192.168.201.3@tcp:33: Request processed in 64940us (65159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837629.217688:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:0.0:1788837629.464936:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837629.465245:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012731776 00000100:00100000:2.0:1788837629.465255:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012731776 00000100:00100000:2.0:1788837629.465358:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:2.0:1788837629.465369:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:6194:x1875732012731776:12345-192.168.201.3@tcp:101: 00010000:00010000:2.0:1788837629.465399:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837629.465436:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aeefb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003e933 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837629.465499:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aeefbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837629.465512:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aeefbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837629.465527:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aeefbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837629.465593:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788837629.465597:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788837629.465614:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aeefbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837629.465639:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aeefb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e933 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837629.465658:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aeefbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e933 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837629.465666:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ac3da1b00) 00010000:00010000:2.0:1788837629.465669:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837629.465672:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6db000, rc 0) 00000100:00100000:2.0:1788837629.465734:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+7:6194:x1875732012731776:12345-192.168.201.3@tcp:101: Request processed in 367us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837629.465742:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00010000:00010000:3.0:1788837629.626681:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837629.883431:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036896512:0@lo:41: 00000100:00100000:2.0:1788837629.883538:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837629.883717:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036896512 00000100:00100000:0.0:1788837629.883726:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036896512 00000100:00100000:0.0:1788837629.883797:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788837629.883807:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036896512:12345-0@lo:41: 00000004:00000024:0.0:1788837629.883848:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788837629.883894:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036896512:12345-0@lo:41: Request processed in 89us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837629.883901:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788837629.884222:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036896512:0@lo:41: 00000100:00100000:3.0:1788837629.884895:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036896896:0@lo:400: 00000100:00100000:3.0:1788837629.884931:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837629.884959:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036897408:0@lo:400: 00000100:00100000:3.0:1788837629.884982:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837629.885013:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036897920:0@lo:400: 00000100:00100000:3.0:1788837629.885036:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837629.885070:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788837629.885076:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036897024:0@lo:400: 00000100:00100000:3.0:1788837629.885101:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837629.885119:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036897536:0@lo:400: 00000100:00100000:3.0:1788837629.885139:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837629.885152:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036898048:0@lo:400: 00000100:00100000:3.0:1788837629.885170:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837629.885194:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036896896 00000100:00100000:3.0:1788837629.885199:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036896896 00000100:00100000:3.0:1788837629.885229:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788837629.885237:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036896896:12345-0@lo:400: 00000100:00100000:3.0:1788837629.885414:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036896896:12345-0@lo:400: Request processed in 176us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837629.885429:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788837629.885514:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036897408 00000100:00100000:3.0:1788837629.885518:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036897408 00000100:00100000:3.0:1788837629.885538:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036897920 00000100:00100000:3.0:1788837629.885541:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036897920 00000100:00100000:3.0:1788837629.885564:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036897536 00000100:00100000:3.0:1788837629.885567:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036897536 00000100:00100000:0.0:1788837629.885688:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036898048 00000100:00100000:0.0:1788837629.885692:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036898048 00000100:00100000:0.0:1788837629.885713:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837629.885720:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036897408:12345-0@lo:400: 00000100:00100000:0.0:1788837629.885755:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036897408:12345-0@lo:400: Request processed in 35us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837629.885761:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837629.885792:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788837629.885799:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036897920:12345-0@lo:400: 00000100:00100000:0.0:1788837629.885824:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036897920:12345-0@lo:400: Request processed in 26us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837629.885830:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788837629.885841:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788837629.885847:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036898048:12345-0@lo:400: 00000100:00100000:0.0:1788837629.885872:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036898048:12345-0@lo:400: Request processed in 26us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837629.885878:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788837629.885918:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036897024 00000100:00100000:0.0:1788837629.885922:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036897024 00000100:00100000:0.0:1788837629.885949:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788837629.885956:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036897024:12345-0@lo:400: 00000100:00100000:0.0:1788837629.885985:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036897024:12345-0@lo:400: Request processed in 30us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837629.885997:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788837629.886045:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036897024:0@lo:400: 00010000:00080000:0.0:1788837629.886073:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac618ce00 x1875732036898048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837629.886083:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788837629.886096:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036898048:0@lo:400: 00000100:00100000:0.0:1788837629.886106:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036896896:0@lo:400: 00010000:00080000:0.0:1788837629.886114:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac618dc00 x1875732036897408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837629.886122:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036897408:0@lo:400: 00010000:00080000:0.0:1788837629.886131:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac618f480 x1875732036897920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837629.886137:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788837629.886144:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036897920:0@lo:400: 00000100:00080000:0.0:1788837629.886178:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837629.886425:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788837629.886432:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036897536:12345-0@lo:400: 00000100:00100000:3.0:1788837629.886479:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036897536:12345-0@lo:400: Request processed in 48us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837629.886485:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788837629.887059:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac618c380 x1875732036897536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837629.887070:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036897536:0@lo:400: 00000100:00100000:2.0:1788837629.887364:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036896768:0@lo:400: 00000100:00100000:2.0:1788837629.887414:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837629.887500:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732036897280:0@lo:400: 00000100:00100000:2.0:1788837629.887528:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837629.887685:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036896640:0@lo:400: 00000100:00100000:1.0:1788837629.887721:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837629.887802:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036897152:0@lo:400: 00000100:00100000:0.0:1788837629.887903:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036896640 00000100:00100000:0.0:1788837629.887910:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036896640 00000100:00100000:0.0:1788837629.887951:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788837629.887959:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036896640:12345-0@lo:400: 00000100:00100000:0.0:1788837629.888010:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036896640:12345-0@lo:400: Request processed in 52us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837629.888024:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788837629.888568:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837629.888662:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732036897792:0@lo:400: 00000100:00100000:3.0:1788837629.888731:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036896768 00000100:00100000:3.0:1788837629.888736:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036896768 00000100:00100000:3.0:1788837629.888773:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036897280 00000100:00100000:3.0:1788837629.888795:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036897280 00000100:00100000:3.0:1788837629.888828:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788837629.888835:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036896768:12345-0@lo:400: 00000100:00100000:3.0:1788837629.888875:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036896768:12345-0@lo:400: Request processed in 41us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837629.888882:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788837629.888897:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788837629.888903:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732036897280:12345-0@lo:400: 00000100:00100000:3.0:1788837629.888931:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732036897280:12345-0@lo:400: Request processed in 29us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837629.888937:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788837629.888952:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837629.895336:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036897664:0@lo:400: 00000100:00100000:1.0:1788837629.895414:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837629.896855:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036898176:0@lo:13: 00000100:00100000:1.0:1788837629.896904:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837629.896956:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036896640:0@lo:400: 00000100:00100000:1.0:1788837629.896992:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036898176 00000100:00100000:1.0:1788837629.896999:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036898176 00000100:00100000:3.0:1788837629.897213:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036897152 00000100:00100000:3.0:1788837629.897232:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036897152 00000100:00100000:1.0:1788837629.897288:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788837629.897300:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036898176:12345-0@lo:13: 00002000:00000024:1.0:1788837629.897327:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837629.897384:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036898176:12345-0@lo:13: Request processed in 86us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837629.897392:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788837629.897429:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa735f80 x1875732036898176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837629.897448:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036898176:0@lo:13: 00000100:00100000:2.0:1788837629.897703:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837629.897955:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036898304:0@lo:13: 00000100:00100000:2.0:1788837629.897984:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837629.898016:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036896768:0@lo:400: 00010000:00080000:2.0:1788837629.898028:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac618e300 x1875732036897280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837629.898038:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732036897280:0@lo:400: 00000100:00100000:2.0:1788837629.898078:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036898304 00000100:00100000:2.0:1788837629.898082:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036898304 00000100:00100000:2.0:1788837629.898108:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837629.898114:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036898304:12345-0@lo:13: 00002000:00000024:2.0:1788837629.898126:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837629.898158:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036898304:12345-0@lo:13: Request processed in 44us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837629.898164:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837629.898200:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036897664 00000100:00100000:0.0:1788837629.898205:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036897664 00000100:00100000:0.0:1788837629.898228:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036897792 00000100:00100000:0.0:1788837629.898231:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036897792 00000100:00100000:0.0:1788837629.898247:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788837629.898253:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036897152:12345-0@lo:400: 00000100:00100000:0.0:1788837629.898309:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036897152:12345-0@lo:400: Request processed in 56us (9741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837629.898316:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788837629.898329:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788837629.898335:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036897664:12345-0@lo:400: 00000100:00100000:0.0:1788837629.898362:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036897664:12345-0@lo:400: Request processed in 28us (2948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837629.898380:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788837629.898393:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788837629.898399:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732036897792:12345-0@lo:400: 00000100:00100000:0.0:1788837629.898426:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732036897792:12345-0@lo:400: Request processed in 29us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837629.898431:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788837629.898686:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036897152:0@lo:400: 00000100:00100000:0.0:1788837629.898698:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036897664:0@lo:400: 00010000:00080000:0.0:1788837629.898753:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac618ca80 x1875732036897792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837629.898763:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732036897792:0@lo:400: 00010000:00080000:0.0:1788837629.898812:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa7ae300 x1875732036898304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837629.898825:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036898304:0@lo:13: 00000100:00080000:3.0:1788837629.898940:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788837629.898945:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788837630.649773:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837630.905448:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036898432:0@lo:41: 00000100:00100000:3.0:1788837630.905519:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837630.905727:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036898432 00000100:00100000:2.0:1788837630.905736:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036898432 00000100:00100000:2.0:1788837630.905807:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788837630.905831:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036898432:12345-0@lo:41: 00000004:00000024:2.0:1788837630.905865:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788837630.905923:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036898432:12345-0@lo:41: Request processed in 94us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837630.905931:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788837630.906016:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036898432:0@lo:41: 00000100:00100000:3.0:1788837631.604204:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837631.604254:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012731904 00000100:00100000:0.0:1788837631.604265:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012731904 00000100:00100000:0.0:1788837631.604400:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:0.0:1788837631.604411:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:6247:x1875732012731904:12345-192.168.201.3@tcp:41: 00000004:00000024:0.0:1788837631.604459:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788837631.604547:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:6247:x1875732012731904:12345-192.168.201.3@tcp:41: Request processed in 132us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837631.604555:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00080000:3.0:1788837631.605386:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837631.610010:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837631.610219:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012732032 00000100:00100000:2.0:1788837631.610228:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012732032 00000100:00100000:2.0:1788837631.610361:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:2.0:1788837631.610374:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:6247:x1875732012732032:12345-192.168.201.3@tcp:41: 00000004:00000024:2.0:1788837631.610415:0:9317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788837631.610499:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:6247:x1875732012732032:12345-192.168.201.3@tcp:41: Request processed in 128us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837631.610507:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00080000:3.0:1788837631.611233:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837631.620031:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837631.620138:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012732160 00000100:00100000:1.0:1788837631.620149:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012732160 00000100:00100000:1.0:1788837631.620221:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:1.0:1788837631.620232:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3a879e24-3b2f-4404-84c2-9101689d9315+6:6247:x1875732012732160:12345-192.168.201.3@tcp:13: 00002000:00000024:1.0:1788837631.620266:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788837631.620406:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837631.620480:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3a879e24-3b2f-4404-84c2-9101689d9315+6:6247:x1875732012732160:12345-192.168.201.3@tcp:13: Request processed in 249us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837631.620503:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:1.0:1788837631.623149:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837631.623241:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012732288 00000100:00100000:2.0:1788837631.623250:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012732288 00000100:00100000:2.0:1788837631.623351:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:2.0:1788837631.623361:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3a879e24-3b2f-4404-84c2-9101689d9315+6:6247:x1875732012732288:12345-192.168.201.3@tcp:13: 00002000:00000024:2.0:1788837631.623389:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837631.623448:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3a879e24-3b2f-4404-84c2-9101689d9315+6:6247:x1875732012732288:12345-192.168.201.3@tcp:13: Request processed in 89us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837631.623454:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00080000:3.0:1788837631.629926:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788837631.673294:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837632.697007:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788837632.954984:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3a879e24-3b2f-4404-84c2-9101689d9315 00000100:00100000:3.0:1788837633.465900:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837633.465941:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036898560:0@lo:13: 00000100:00100000:0.0:1788837633.465956:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837633.465972:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036898688:0@lo:13: 00000100:00100000:3.0:1788837633.466016:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837633.466033:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837633.466113:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036898560 00000100:00100000:1.0:1788837633.466122:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036898560 00000100:00100000:1.0:1788837633.466178:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036898688 00000100:00100000:1.0:1788837633.466182:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036898688 00000100:00100000:1.0:1788837633.466203:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788837633.466211:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036898560:12345-0@lo:13: 00002000:00000024:1.0:1788837633.466241:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837633.466314:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036898560:12345-0@lo:13: Request processed in 93us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837633.466329:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788837633.466349:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788837633.466356:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036898688:12345-0@lo:13: 00002000:00000024:1.0:1788837633.466366:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837633.466390:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036898688:12345-0@lo:13: Request processed in 34us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837633.466395:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788837633.466426:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c31b4a80 x1875732036898560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837633.466444:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036898560:0@lo:13: 00000100:00080000:3.0:1788837633.466507:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837633.469650:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa737480 x1875732036898688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837633.469676:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036898688:0@lo:13: 00010000:00010000:3.0:1788837633.721092:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788837633.979357:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3a879e24-3b2f-4404-84c2-9101689d9315 00000001:00100000:0.0:1788837633.988543:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3a879e24-3b2f-4404-84c2-9101689d9315 00000001:02000400:2.0:1788837634.390882:0:10189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788837634.552011:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837634.552052:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837634.552077:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837634.552093:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837634.552141:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837634.552167:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012732672 00000100:00100000:0.0:1788837634.552176:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012732672 00000100:00100000:0.0:1788837634.552241:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012732544 00000100:00100000:0.0:1788837634.552245:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012732544 00000100:00100000:0.0:1788837634.552270:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:0.0:1788837634.552279:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012732672:12345-192.168.201.3@tcp:400: 00000100:00100000:0.0:1788837634.552359:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012732672:12345-192.168.201.3@tcp:400: Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837634.552367:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:0.0:1788837634.552383:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:0.0:1788837634.552390:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012732544:12345-192.168.201.3@tcp:400: 00000100:00100000:0.0:1788837634.552413:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012732544:12345-192.168.201.3@tcp:400: Request processed in 24us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837634.552419:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:0.0:1788837634.552435:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012732928 00000100:00100000:0.0:1788837634.552439:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012732928 00000100:00100000:0.0:1788837634.552463:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012732800 00000100:00100000:0.0:1788837634.552465:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012732800 00000100:00100000:0.0:1788837634.552487:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:0.0:1788837634.552493:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012732928:12345-192.168.201.3@tcp:400: 00000100:00100000:0.0:1788837634.552518:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012732928:12345-192.168.201.3@tcp:400: Request processed in 25us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837634.552524:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:0.0:1788837634.552534:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:0.0:1788837634.552539:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012732800:12345-192.168.201.3@tcp:400: 00000100:00100000:0.0:1788837634.552567:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012732800:12345-192.168.201.3@tcp:400: Request processed in 29us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837634.552573:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:3.0:1788837634.553012:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012732416 00000100:00100000:3.0:1788837634.553017:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012732416 00000100:00100000:3.0:1788837634.553062:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 198 00000100:00100000:3.0:1788837634.553069:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2395:x1875732012732416:12345-192.168.201.3@tcp:400: 00000100:00100000:3.0:1788837634.553101:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2395:x1875732012732416:12345-192.168.201.3@tcp:400: Request processed in 33us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837634.553106:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 198 00000100:00080000:3.0:1788837634.553134:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837634.553138:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837634.553140:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837634.553142:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788837634.746539:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837635.003767:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837635.003812:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036898816:0@lo:400: 00000100:00100000:2.0:1788837635.003893:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837635.003983:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036898944:0@lo:400: 00000100:00100000:2.0:1788837635.004008:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837635.004043:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036899072:0@lo:400: 00000100:00100000:2.0:1788837635.004061:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837635.004088:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036899200:0@lo:400: 00000100:00100000:2.0:1788837635.004102:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837635.004122:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837635.004125:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036899328:0@lo:400: 00000100:00100000:2.0:1788837635.004138:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837635.004156:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036899072 00000100:00100000:2.0:1788837635.004162:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036899072 00000100:00100000:2.0:1788837635.004192:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036899328 00000100:00100000:2.0:1788837635.004194:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036899328 00000100:00100000:2.0:1788837635.004208:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788837635.004231:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036899072:12345-0@lo:400: 00000100:00100000:2.0:1788837635.004315:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036899072:12345-0@lo:400: Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837635.004323:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788837635.004339:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788837635.004344:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036899328:12345-0@lo:400: 00000100:00100000:2.0:1788837635.004368:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036899328:12345-0@lo:400: Request processed in 25us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837635.004372:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788837635.004395:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036899072:0@lo:400: 00000100:00100000:2.0:1788837635.004411:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036899328:0@lo:400: 00000100:00100000:2.0:1788837635.004428:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036899456:0@lo:400: 00000100:00100000:2.0:1788837635.004449:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837635.004475:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036899584:0@lo:400: 00000100:00100000:2.0:1788837635.004487:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837635.004508:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036899712:0@lo:400: 00000100:00100000:2.0:1788837635.004545:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837635.004570:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837635.004574:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036899840:0@lo:400: 00000100:00100000:2.0:1788837635.004588:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837635.004608:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036899968:0@lo:400: 00000100:00100000:2.0:1788837635.004620:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837635.004640:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036900096:0@lo:400: 00000100:00100000:2.0:1788837635.004652:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837635.004671:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036900224:0@lo:400: 00000100:00100000:2.0:1788837635.004683:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837635.004703:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837635.004706:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036900352:0@lo:400: 00000100:00100000:2.0:1788837635.004725:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837635.004945:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036898816 00000100:00100000:0.0:1788837635.004950:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036898816 00000100:00100000:0.0:1788837635.004982:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788837635.004989:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036898816:12345-0@lo:400: 00000100:00100000:0.0:1788837635.005028:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036898816:12345-0@lo:400: Request processed in 40us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837635.005034:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788837635.005061:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036898944 00000100:00100000:0.0:1788837635.005065:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036898944 00000100:00100000:0.0:1788837635.005083:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036899200 00000100:00100000:0.0:1788837635.005086:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036899200 00000100:00100000:0.0:1788837635.005095:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036899456 00000100:00100000:0.0:1788837635.005098:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036899456 00000100:00100000:0.0:1788837635.005116:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036899584 00000100:00100000:0.0:1788837635.005119:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036899584 00000100:00100000:0.0:1788837635.005129:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036899968 00000100:00100000:0.0:1788837635.005131:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036899968 00000100:00100000:0.0:1788837635.005141:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036900096 00000100:00100000:0.0:1788837635.005143:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036900096 00000100:00100000:0.0:1788837635.005154:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788837635.005160:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036898944:12345-0@lo:400: 00000100:00100000:0.0:1788837635.005186:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036898944:12345-0@lo:400: Request processed in 27us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837635.005191:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788837635.005200:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788837635.005205:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036899200:12345-0@lo:400: 00000100:00100000:0.0:1788837635.005256:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036899200:12345-0@lo:400: Request processed in 50us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837635.005262:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788837635.005274:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788837635.005292:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036899456:12345-0@lo:400: 00000100:00100000:0.0:1788837635.005319:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036899456:12345-0@lo:400: Request processed in 40us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837635.005326:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788837635.005336:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788837635.005342:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036899584:12345-0@lo:400: 00000100:00100000:0.0:1788837635.005364:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036899584:12345-0@lo:400: Request processed in 24us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837635.005368:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788837635.005375:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788837635.005378:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036899968:12345-0@lo:400: 00000100:00100000:0.0:1788837635.005392:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036899968:12345-0@lo:400: Request processed in 14us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837635.005396:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788837635.005401:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788837635.005404:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036900096:12345-0@lo:400: 00000100:00100000:0.0:1788837635.005416:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036900096:12345-0@lo:400: Request processed in 12us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837635.005419:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788837635.005442:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036899712 00000100:00100000:0.0:1788837635.005444:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036899712 00000100:00100000:0.0:1788837635.005457:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036899840 00000100:00100000:0.0:1788837635.005462:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036899840 00000100:00100000:0.0:1788837635.005471:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036900224 00000100:00100000:0.0:1788837635.005473:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036900224 00000100:00100000:0.0:1788837635.005478:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036900352 00000100:00100000:0.0:1788837635.005480:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036900352 00000100:00100000:0.0:1788837635.005486:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788837635.005489:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036899712:12345-0@lo:400: 00000100:00100000:0.0:1788837635.005509:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036899712:12345-0@lo:400: Request processed in 20us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837635.005512:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788837635.005518:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837635.005521:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036899840:12345-0@lo:400: 00000100:00100000:0.0:1788837635.005534:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036899840:12345-0@lo:400: Request processed in 12us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837635.005537:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837635.005542:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837635.005545:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036900224:12345-0@lo:400: 00000100:00100000:0.0:1788837635.005556:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036900224:12345-0@lo:400: Request processed in 11us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837635.005559:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837635.005564:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788837635.005567:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036900352:12345-0@lo:400: 00000100:00100000:0.0:1788837635.005579:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036900352:12345-0@lo:400: Request processed in 11us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837635.005582:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788837635.005610:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6ed180 x1875732036900096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837635.005627:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036900096:0@lo:400: 00010000:00080000:0.0:1788837635.005635:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa7ad180 x1875732036899584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837635.005640:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036899584:0@lo:400: 00000100:00100000:0.0:1788837635.005652:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837635.005656:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036900480:0@lo:41: 00000100:00100000:0.0:1788837635.005673:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837635.005696:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036899968:0@lo:400: 00000100:00100000:0.0:1788837635.005702:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036899456:0@lo:400: 00000100:00100000:0.0:1788837635.005709:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036898944:0@lo:400: 00000100:00100000:0.0:1788837635.005728:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036900480 00000100:00100000:0.0:1788837635.005731:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036900480 00000100:00100000:0.0:1788837635.005752:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788837635.005758:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036900480:12345-0@lo:41: 00000004:00000024:0.0:1788837635.005804:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788837635.005832:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036900480:12345-0@lo:41: Request processed in 75us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837635.005836:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788837635.005856:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036900480:0@lo:41: 00010000:00080000:0.0:1788837635.005870:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6edc00 x1875732036900352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837635.005875:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036900352:0@lo:400: 00010000:00080000:0.0:1788837635.005880:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6ef100 x1875732036900224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837635.005890:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036900224:0@lo:400: 00010000:00080000:0.0:1788837635.005897:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6efb80 x1875732036899840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837635.005902:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036899840:0@lo:400: 00010000:00080000:0.0:1788837635.005907:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa7ae300 x1875732036899712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837635.005911:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036899712:0@lo:400: 00000100:00100000:0.0:1788837635.005917:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036899200:0@lo:400: 00000100:00100000:0.0:1788837635.005923:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036898816:0@lo:400: 00000100:00080000:3.0:1788837635.006119:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837635.006123:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837635.006124:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788837635.006126:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837635.006826:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837635.006843:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036900608:0@lo:13: 00000100:00100000:0.0:1788837635.006917:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036900736:0@lo:13: 00000100:00100000:0.0:1788837635.006956:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837635.006983:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036900736 00000100:00100000:1.0:1788837635.006992:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036900736 00000100:00100000:2.0:1788837635.007039:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837635.007397:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036900608 00000100:00100000:1.0:1788837635.007402:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036900608 00000100:00100000:1.0:1788837635.007427:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788837635.007434:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036900736:12345-0@lo:13: 00002000:00000024:1.0:1788837635.007459:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837635.007520:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036900736:12345-0@lo:13: Request processed in 86us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837635.007527:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788837635.007543:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788837635.007548:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036900608:12345-0@lo:13: 00002000:00000024:1.0:1788837635.007557:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837635.007589:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036900608:12345-0@lo:13: Request processed in 41us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837635.007595:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788837635.007628:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6ec700 x1875732036900608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837635.007645:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036900608:0@lo:13: 00010000:00080000:2.0:1788837635.009402:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa7ace00 x1875732036900736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837635.009425:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036900736:0@lo:13: 00000001:00100000:3.0:1788837635.012534:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3a879e24-3b2f-4404-84c2-9101689d9315 00010000:00010000:3.0:1788837635.773239:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837636.024958:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837636.024990:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036900864:0@lo:41: 00000100:00100000:0.0:1788837636.025067:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837636.025131:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036900864 00000100:00100000:0.0:1788837636.025138:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036900864 00000100:00100000:0.0:1788837636.025182:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788837636.025190:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036900864:12345-0@lo:41: 00000004:00000024:0.0:1788837636.025220:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788837636.025272:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036900864:12345-0@lo:41: Request processed in 71us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837636.025279:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788837636.025380:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036900864:0@lo:41: 00010000:00010000:3.0:1788837636.799972:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788837637.600188:0:10337:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa3055fa0 20000000:00000080:0.0:1788837637.600204:0:10337:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8899c3504400 uarg=0000000000000000 20000000:01000000:0.0:1788837637.600328:0:10337:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788837637.600331:0:10337:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788837637.600334:0:10337:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788837637.600338:0:10337:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788837637.600343:0:10337:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788837637.600401:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788837637.600404:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788837637.600800:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1788837637.601286:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1788837637.601312:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1788837637.601327:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1788837637.601337:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788837637.601340:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788837637.601616:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1788837637.601751:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1788837637.601771:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1788837637.601957:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1788837637.601971:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788837637.601972:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788837637.602265:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1788837637.602543:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1788837637.602569:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1788837637.602585:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1788837637.602593:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788837637.602595:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788837637.603003:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1788837637.603173:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1788837637.603203:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1788837637.603219:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1788837637.603228:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788837637.603230:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788837637.603494:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1788837637.603613:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1788837637.603625:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1788837637.603633:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:1.0:1788837637.603641:0:10337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788837637.603656:0:10337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837637.603670:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeee61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeee5a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837637.603676:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac0031800/0x57f6d4e926aeee8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeee84 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837637.603680:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeeeca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeec3 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837637.603684:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac0030200/0x57f6d4e926aeeed8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeed1 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837637.603688:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac0031e00/0x57f6d4e926aeeee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeedf expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837637.603692:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b17600/0x57f6d4e926aeef02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeefb expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837637.603695:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeef2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeef25 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837637.603706:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b17400/0x57f6d4e926aeef48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeef41 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837637.603711:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b16600/0x57f6d4e926aeef72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeef6b expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837637.603717:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa790a00/0x57f6d4e926aeef80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e8c3 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837637.603721:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa791200/0x57f6d4e926aeef87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e8ca expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837637.603725:0:10337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837637.603754:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa791200/0x57f6d4e926aeef87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e8ca expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837637.603764:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889afa791200/0x57f6d4e926aeef87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e8ca expref: 9 pid: 6519 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837637.605513:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036900992:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837637.607180:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa790a00/0x57f6d4e926aeef80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e8c3 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.607193:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889afa790a00/0x57f6d4e926aeef80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e8c3 expref: 9 pid: 6519 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837637.607207:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036901120:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837637.607260:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b16600/0x57f6d4e926aeef72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeef6b expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.607269:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac2b16600/0x57f6d4e926aeef72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeef6b expref: 23 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837637.607277:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036901248:0@lo:104: 00000100:00100000:0.0:1788837637.607325:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837637.607369:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b17400/0x57f6d4e926aeef48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeef41 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.607377:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac2b17400/0x57f6d4e926aeef48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeef41 expref: 23 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837637.607386:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036901376:0@lo:104: 00000100:00100000:0.0:1788837637.607407:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837637.607439:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeef2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeef25 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.607445:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeef2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeef25 expref: 23 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837637.607450:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036901504:0@lo:104: 00000100:00100000:0.0:1788837637.607464:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837637.607474:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b17600/0x57f6d4e926aeef02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeeefb expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.607479:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac2b17600/0x57f6d4e926aeef02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeeefb expref: 23 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837637.607483:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2512300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036901632:0@lo:104: 00000100:00100000:0.0:1788837637.607495:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837637.607503:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac0031e00/0x57f6d4e926aeeee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeeedf expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.607510:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac0031e00/0x57f6d4e926aeeee6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeeedf expref: 23 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837637.607530:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036901760:0@lo:104: 00010000:00010000:0.0:1788837637.607558:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac0030200/0x57f6d4e926aeeed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeeed1 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.607566:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac0030200/0x57f6d4e926aeeed8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeeed1 expref: 23 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837637.607574:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2512680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036901888:0@lo:104: 00010000:00010000:0.0:1788837637.607601:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeeeca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeeec3 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.607609:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeeeca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeeec3 expref: 23 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837637.607617:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036902016:0@lo:104: 00010000:00010000:0.0:1788837637.607659:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac0031800/0x57f6d4e926aeee8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeee84 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.607666:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac0031800/0x57f6d4e926aeee8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeee84 expref: 23 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837637.607672:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036902144:0@lo:104: 00010000:00010000:0.0:1788837637.607695:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeee61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeee5a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.607702:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeee61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeee5a expref: 23 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837637.607732:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036902272:0@lo:104: 00000100:00100000:0.0:1788837637.607753:0:10337:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded0b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788837637.607956:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788837637.607975:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837637.607989:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837637.607997:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837637.608006:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837637.608014:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837637.608022:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036901248 00000100:00100000:3.0:1788837637.608028:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036901248 00000100:00100000:3.0:1788837637.608068:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036901376 00000100:00100000:3.0:1788837637.608071:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036901376 00000100:00100000:3.0:1788837637.608081:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036901504 00000100:00100000:3.0:1788837637.608083:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036901504 00000100:00100000:3.0:1788837637.608091:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036901632 00000100:00100000:3.0:1788837637.608093:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036901632 00000100:00100000:3.0:1788837637.608100:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036901760 00000100:00100000:3.0:1788837637.608103:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036901760 00000100:00100000:3.0:1788837637.608110:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036901888 00000100:00100000:3.0:1788837637.608112:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036901888 00000100:00100000:3.0:1788837637.608120:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036902016 00000100:00100000:3.0:1788837637.608123:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036902016 00000100:00100000:3.0:1788837637.608130:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036902144 00000100:00100000:3.0:1788837637.608132:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036902144 00000100:00100000:3.0:1788837637.608139:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036902272 00000100:00100000:3.0:1788837637.608153:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036902272 00000100:00100000:3.0:1788837637.608169:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837637.608176:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:10337:x1875732036901248:12345-0@lo:104: 00010000:00010000:3.0:1788837637.608193:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeef72 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.608262:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837637.608268:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:10337:x1875732036901248:12345-0@lo:104: Request processed in 92us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.608275:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837637.608291:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788837637.608297:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2511180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+10:10337:x1875732036901376:12345-0@lo:104: 00010000:00010000:3.0:1788837637.608304:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeef48 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.608337:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788837637.608342:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2511180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+10:10337:x1875732036901376:12345-0@lo:104: Request processed in 46us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.608347:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788837637.608358:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788837637.608364:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+9:10337:x1875732036901504:12345-0@lo:104: 00010000:00010000:3.0:1788837637.608370:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeef2c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.608396:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788837637.608401:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2512a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+9:10337:x1875732036901504:12345-0@lo:104: Request processed in 38us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.608407:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788837637.608420:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788837637.608425:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c269e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+8:10337:x1875732036901632:12345-0@lo:104: 00010000:00010000:3.0:1788837637.608437:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeef02 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.608464:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788837637.608469:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c269e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+8:10337:x1875732036901632:12345-0@lo:104: Request processed in 45us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.608475:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788837637.608503:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788837637.608509:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+7:10337:x1875732036901760:12345-0@lo:104: 00010000:00010000:3.0:1788837637.608516:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeee6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.608543:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788837637.608547:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+7:10337:x1875732036901760:12345-0@lo:104: Request processed in 40us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.608552:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788837637.608563:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788837637.608568:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+6:10337:x1875732036901888:12345-0@lo:104: 00010000:00010000:3.0:1788837637.608575:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeed8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.608599:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788837637.608604:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+6:10337:x1875732036901888:12345-0@lo:104: Request processed in 37us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.608609:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788837637.608620:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837637.608624:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+5:10337:x1875732036902016:12345-0@lo:104: 00010000:00010000:3.0:1788837637.608637:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeeca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.608663:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788837637.608668:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+5:10337:x1875732036902016:12345-0@lo:104: Request processed in 44us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.608673:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837637.608684:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788837637.608689:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:10337:x1875732036902144:12345-0@lo:104: 00010000:00010000:3.0:1788837637.608694:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeee8b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.608717:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1788837637.608721:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:10337:x1875732036902144:12345-0@lo:104: Request processed in 33us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.608726:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788837637.608735:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837637.608741:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:10337:x1875732036902272:12345-0@lo:104: 00010000:00010000:3.0:1788837637.608747:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeee61 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.608770:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1788837637.608818:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:10337:x1875732036902272:12345-0@lo:104: Request processed in 35us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.608824:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788837637.609091:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036901248:0@lo:104: 00000100:00100000:0.0:1788837637.609102:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036901376:0@lo:104: 00000100:00100000:0.0:1788837637.609109:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036901504:0@lo:104: 00000100:00100000:0.0:1788837637.609115:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2512300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036901632:0@lo:104: 00000100:00100000:0.0:1788837637.609120:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036901760:0@lo:104: 00000100:00100000:0.0:1788837637.609126:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2512680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036901888:0@lo:104: 00000100:00100000:0.0:1788837637.609134:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036902016:0@lo:104: 00000100:00100000:0.0:1788837637.609152:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036902144:0@lo:104: 00000100:00100000:0.0:1788837637.609161:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036902272:0@lo:104: 00010000:00010000:3.0:1788837637.609522:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788837637.609530:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeef72 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.609545:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8c00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837637.609549:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeef72 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.609558:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeef72 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837637.609564:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeef72 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837637.609569:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837637.609650:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeef72 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.609658:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788837637.609702:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036902400:0@lo:103: 00000100:00100000:1.0:1788837637.609762:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837637.609868:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036902400 00000100:00100000:2.0:1788837637.609876:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036902400 00010000:00010000:2.0:1788837637.609909:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b16600/0x57f6d4e926aeef72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeef6b expref: 24 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837637.609936:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788837637.609943:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8567050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3650:x1875732036902400:12345-0@lo:103: 00010000:00010000:2.0:1788837637.609955:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837637.609960:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b16600/0x57f6d4e926aeef72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeef6b expref: 24 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837637.609970:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b16600/0x57f6d4e926aeef72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeef6b expref: 24 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837637.609984:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b16600/0x57f6d4e926aeef72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeef6b expref: 24 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837637.609999:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837637.610052:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeef72 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610060:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926aeef6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeef72 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610070:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788837637.610074:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeef48 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610079:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0030a00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837637.610082:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeef48 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610099:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeef48 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837637.610105:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeef48 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837637.610110:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837637.610362:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeef48 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610370:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837637.610376:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeef48 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610382:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac0030a00/0x57f6d4e926aeef41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeef48 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610393:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788837637.610396:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeef2c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610401:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8200 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837637.610404:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeef2c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610411:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeef2c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837637.610418:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeef2c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837637.610429:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837637.610444:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeef2c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610449:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837637.610466:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeef2c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610473:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6c8200/0x57f6d4e926aeef25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeef2c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610482:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788837637.610485:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeef02 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610491:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dac00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837637.610493:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeef02 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610500:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeef02 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837637.610505:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeef02 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837637.610511:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837637.610522:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeef02 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610528:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837637.610539:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeef02 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610545:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aeeefb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeef02 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610553:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788837637.610556:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeee6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610561:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dbe00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837637.610563:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeeee6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610568:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeeee6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837637.610573:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeeee6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837637.610578:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837637.610590:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeee6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610595:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837637.610600:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeee6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610606:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aeeedf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeee6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610614:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788837637.610623:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeed8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610628:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8e00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837637.610630:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeeed8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610636:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeeed8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837637.610641:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeeed8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837637.610645:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837637.610658:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeed8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610663:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837637.610667:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeed8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610672:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926aeeed1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeed8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610680:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788837637.610683:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeeeca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610687:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17a00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837637.610690:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeeeca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610705:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeeeca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837637.610718:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeeeca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837637.610724:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837637.610738:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeeca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610742:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837637.610747:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeeca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610753:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aeeec3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeeeca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610760:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837637.610763:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeee8b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610768:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0031400 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837637.610770:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeee8b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.610801:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeee8b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837637.610807:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeee8b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837637.611123:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837637.611167:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee8b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.611174:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837637.611178:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee8b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.611184:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac0031400/0x57f6d4e926aeee84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee8b expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.611194:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837637.611198:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeee61 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.611204:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16800 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837637.611207:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeee61 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.611214:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeee61 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837637.611219:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeee61 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837637.611224:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837637.611247:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee61 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.611252:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837637.611262:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee61 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.611267:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b16800/0x57f6d4e926aeee5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee61 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.611281:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837637.611283:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837637.611285:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837637.611294:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837637.611308:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036902528:0@lo:103: 00000100:00100000:3.0:1788837637.611356:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837637.611395:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036903040:0@lo:103: 00000100:00100000:3.0:1788837637.611415:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837637.611440:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788837637.611445:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036902912:0@lo:103: 00000100:00100000:3.0:1788837637.611464:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837637.611479:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036903424:0@lo:103: 00000100:00100000:3.0:1788837637.611496:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837637.611514:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036902656:0@lo:103: 00000100:00100000:3.0:1788837637.611534:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837637.611544:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036903168:0@lo:103: 00000100:00100000:3.0:1788837637.611562:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837637.611573:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788837637.611577:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036902784:0@lo:103: 00000100:00100000:3.0:1788837637.611595:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837637.611603:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036903296:0@lo:103: 00000100:00100000:3.0:1788837637.611630:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837637.611653:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036902528 00000100:00100000:3.0:1788837637.611658:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036902528 00010000:00010000:3.0:1788837637.611683:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b17400/0x57f6d4e926aeef48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeef41 expref: 24 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837637.611699:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036903040 00000100:00100000:3.0:1788837637.611702:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036903040 00010000:00010000:3.0:1788837637.611713:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac0030200/0x57f6d4e926aeeed8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeed1 expref: 25 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837637.611723:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036902912 00000100:00100000:3.0:1788837637.611726:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036902912 00010000:00010000:3.0:1788837637.611735:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac0031e00/0x57f6d4e926aeeee6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeedf expref: 26 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837637.611745:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036903424 00000100:00100000:3.0:1788837637.611747:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036903424 00010000:00010000:3.0:1788837637.611756:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeee61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeee5a expref: 27 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837637.611768:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036902656 00000100:00100000:3.0:1788837637.611770:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036902656 00010000:00010000:3.0:1788837637.611812:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeef2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeef25 expref: 28 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837637.611824:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036903168 00000100:00100000:3.0:1788837637.611827:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036903168 00010000:00010000:3.0:1788837637.611837:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeeeca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeec3 expref: 29 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837637.611846:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036902784 00000100:00100000:3.0:1788837637.611855:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036902784 00010000:00010000:3.0:1788837637.611867:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b17600/0x57f6d4e926aeef02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeefb expref: 30 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837637.611878:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036903296 00000100:00100000:3.0:1788837637.611880:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036903296 00010000:00010000:3.0:1788837637.611889:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac0031800/0x57f6d4e926aeee8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeee84 expref: 31 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837637.611902:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788837637.611909:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+31:3651:x1875732036902528:12345-0@lo:103: 00010000:00010000:3.0:1788837637.611920:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837637.611924:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b17400/0x57f6d4e926aeef48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeef41 expref: 31 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.611934:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b17400/0x57f6d4e926aeef48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeef41 expref: 31 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.611948:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b17400/0x57f6d4e926aeef48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeef41 expref: 31 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.611960:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837637.611993:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+30:3651:x1875732036902528:12345-0@lo:103: Request processed in 84us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.612000:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788837637.612018:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788837637.612024:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+29:3651:x1875732036903040:12345-0@lo:103: 00010000:00010000:3.0:1788837637.612033:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837637.612037:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac0030200/0x57f6d4e926aeeed8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeed1 expref: 29 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612055:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac0030200/0x57f6d4e926aeeed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeeed1 expref: 29 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612065:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac0030200/0x57f6d4e926aeeed8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeeed1 expref: 29 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612074:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837637.612098:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+28:3651:x1875732036903040:12345-0@lo:103: Request processed in 75us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.612105:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788837637.612118:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788837637.612124:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+27:3651:x1875732036902912:12345-0@lo:103: 00010000:00010000:3.0:1788837637.612132:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837637.612136:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac0031e00/0x57f6d4e926aeeee6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeedf expref: 27 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612144:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac0031e00/0x57f6d4e926aeeee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeeedf expref: 27 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612153:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac0031e00/0x57f6d4e926aeeee6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeeedf expref: 27 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612161:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837637.612183:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+26:3651:x1875732036902912:12345-0@lo:103: Request processed in 60us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.612188:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788837637.612199:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788837637.612205:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+25:3651:x1875732036903424:12345-0@lo:103: 00010000:00010000:3.0:1788837637.612220:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837637.612225:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeee61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeee5a expref: 25 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612244:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeee61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeee5a expref: 25 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612254:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeee61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeee5a expref: 25 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612262:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837637.612287:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732036903424:12345-0@lo:103: Request processed in 82us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.612292:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788837637.612306:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788837637.612311:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3728380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:3648:x1875732036902656:12345-0@lo:103: 00010000:00010000:3.0:1788837637.612318:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837637.612323:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeef2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeef25 expref: 23 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612330:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeef2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeef25 expref: 23 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612339:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac0030e00/0x57f6d4e926aeef2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeef25 expref: 23 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612346:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837637.612371:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3728380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:3648:x1875732036902656:12345-0@lo:103: Request processed in 61us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.612385:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788837637.612399:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837637.612405:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3728700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:3648:x1875732036903168:12345-0@lo:103: 00010000:00010000:3.0:1788837637.612412:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837637.612417:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeeeca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeec3 expref: 21 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612425:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeeeca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeeec3 expref: 21 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612434:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6da600/0x57f6d4e926aeeeca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeeec3 expref: 21 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612442:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837637.612464:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3728700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:3648:x1875732036903168:12345-0@lo:103: Request processed in 59us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.612469:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837637.612481:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788837637.612487:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8561c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:3648:x1875732036902784:12345-0@lo:103: 00010000:00010000:3.0:1788837637.612495:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837637.612499:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b17600/0x57f6d4e926aeef02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeefb expref: 19 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612507:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b17600/0x57f6d4e926aeef02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeeefb expref: 19 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612516:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b17600/0x57f6d4e926aeef02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeeefb expref: 19 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612534:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837637.612557:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8561c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:3648:x1875732036902784:12345-0@lo:103: Request processed in 70us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.612563:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788837637.612589:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837637.612595:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:3648:x1875732036903296:12345-0@lo:103: 00010000:00010000:3.0:1788837637.612602:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837637.612605:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac0031800/0x57f6d4e926aeee8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeee84 expref: 17 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612613:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac0031800/0x57f6d4e926aeee8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeee84 expref: 17 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612621:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac0031800/0x57f6d4e926aeee8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeee84 expref: 17 pid: 6518 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.612629:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837637.612650:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:3648:x1875732036903296:12345-0@lo:103: Request processed in 55us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.612655:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837637.612693:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036902784:0@lo:103: 00000100:00100000:3.0:1788837637.612702:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036903296:0@lo:103: 00000100:00100000:3.0:1788837637.612708:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036902656:0@lo:103: 00000100:00100000:3.0:1788837637.612714:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036903168:0@lo:103: 00000100:00100000:3.0:1788837637.612752:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036902912:0@lo:103: 00000100:00100000:3.0:1788837637.612770:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036903424:0@lo:103: 00000100:00100000:3.0:1788837637.612801:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036902528:0@lo:103: 00000100:00100000:3.0:1788837637.612808:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036903040:0@lo:103: 00000100:00100000:2.0:1788837637.615431:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8567050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:3650:x1875732036902400:12345-0@lo:103: Request processed in 5478us (5658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837637.615444:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788837637.615674:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837637.615749:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837637.615813:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012733056 00000100:00100000:0.0:1788837637.615821:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012733056 00010000:00010000:0.0:1788837637.615863:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa791200/0x57f6d4e926aeef87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e8ca expref: 10 pid: 6519 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837637.615888:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012733184 00000100:00100000:0.0:1788837637.615891:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012733184 00010000:00010000:0.0:1788837637.615902:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa790a00/0x57f6d4e926aeef80 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e8c3 expref: 11 pid: 6519 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837637.615920:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:0.0:1788837637.615928:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2513b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:2396:x1875732012733056:12345-192.168.201.3@tcp:103: 00010000:00010000:0.0:1788837637.615956:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837637.615962:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa791200/0x57f6d4e926aeef87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e8ca expref: 11 pid: 6519 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.615974:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa791200/0x57f6d4e926aeef87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e8ca expref: 11 pid: 6519 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.615993:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837637.616040:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2513b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:2396:x1875732012733056:12345-192.168.201.3@tcp:103: Request processed in 113us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837637.616048:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:0.0:1788837637.616063:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:0.0:1788837637.616071:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2511500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2396:x1875732012733184:12345-192.168.201.3@tcp:103: 00010000:00010000:0.0:1788837637.616079:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837637.616083:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa790a00/0x57f6d4e926aeef80 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e8c3 expref: 10 pid: 6519 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.616092:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa790a00/0x57f6d4e926aeef80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e8c3 expref: 10 pid: 6519 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.616104:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.616112:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.616126:0:9528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.616142:0:9528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.616148:0:9528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.616154:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.616160:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837637.616164:0:9528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.616172:0:9528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.616181:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.616191:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837637.616211:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2511500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2396:x1875732012733184:12345-192.168.201.3@tcp:103: Request processed in 141us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837637.616218:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:1.0:1788837637.616724:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036902400:0@lo:103: 00010000:00010000:2.0:1788837637.617151:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa791200/0x57f6d4e926aeef87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e8ca expref: 9 pid: 6519 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837637.617165:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036900992:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837637.617177:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa790a00/0x57f6d4e926aeef80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e8c3 expref: 8 pid: 6519 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837637.617185:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875732036901120:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837637.617224:0:10337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837637.617259:0:10337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837637.617269:0:10337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837637.617274:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c9200/0x57f6d4e926aeefc6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837637.683162:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837637.683249:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012733312 00000100:00100000:3.0:1788837637.683259:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012733312 00000100:00100000:3.0:1788837637.683316:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 200 00000100:00100000:3.0:1788837637.683327:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+8:6167:x1875732012733312:12345-192.168.201.3@tcp:101: 00010000:00010000:3.0:1788837637.683343:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837637.683364:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b17600/0x57f6d4e926aeefcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003e93a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.683391:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17600/0x57f6d4e926aeefcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e93a expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.683402:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b17600/0x57f6d4e926aeefcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e93a expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837637.683411:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17600, rc 0) 00000100:00100000:3.0:1788837637.683475:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6167:x1875732012733312:12345-192.168.201.3@tcp:101: Request processed in 150us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.683482:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 200 00000100:00100000:0.0:1788837637.689123:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837637.689730:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012733440 00000100:00100000:2.0:1788837637.689740:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012733440 00000100:00100000:2.0:1788837637.689824:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 201 00000100:00100000:2.0:1788837637.689834:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6167:x1875732012733440:12345-192.168.201.3@tcp:501: 00000100:00100000:2.0:1788837637.690021:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6167:x1875732012733440:12345-192.168.201.3@tcp:501: Request processed in 188us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837637.690029:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 201 00000100:00100000:1.0:1788837637.694444:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837637.694516:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012733568 00000100:00100000:2.0:1788837637.694526:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012733568 00000100:00100000:2.0:1788837637.694584:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 202 00000100:00100000:2.0:1788837637.694594:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6167:x1875732012733568:12345-192.168.201.3@tcp:503: 00000100:00100000:2.0:1788837637.694740:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6167:x1875732012733568:12345-192.168.201.3@tcp:503: Request processed in 147us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837637.694748:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 202 00000100:00100000:3.0:1788837637.705181:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837637.708505:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012733696 00000100:00100000:1.0:1788837637.708529:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012733696 00000100:00100000:1.0:1788837637.708611:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 203 00000100:00100000:1.0:1788837637.708620:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6637:x1875732012733696:12345-192.168.201.3@tcp:502: 00000100:00100000:1.0:1788837637.708767:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6637:x1875732012733696:12345-192.168.201.3@tcp:502: Request processed in 146us (3595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837637.708791:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 203 00000100:00100000:0.0:1788837637.718535:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837637.718936:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012733824 00000100:00100000:3.0:1788837637.718946:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012733824 00000100:00100000:3.0:1788837637.719077:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 204 00000100:00100000:3.0:1788837637.719088:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6637:x1875732012733824:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837637.719342:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6637:x1875732012733824:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 255us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837637.719351:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 204 00000100:00100000:1.0:1788837637.732515:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837637.732853:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012733952 00000100:00100000:0.0:1788837637.732864:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012733952 00000100:00100000:0.0:1788837637.732921:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 205 00000100:00100000:0.0:1788837637.732932:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6167:x1875732012733952:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837637.732961:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837637.732979:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa790c00/0x57f6d4e926aeefd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003e941 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.733008:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa790c00/0x57f6d4e926aeefd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e941 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.733020:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa790c00/0x57f6d4e926aeefd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e941 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837637.733031:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790c00, rc 0) 00000100:00100000:0.0:1788837637.733090:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6167:x1875732012733952:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 160us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837637.733097:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 205 00000100:00100000:1.0:1788837637.739479:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837637.739568:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012734080 00000100:00100000:2.0:1788837637.739590:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012734080 00000100:00100000:2.0:1788837637.739651:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 206 00000100:00100000:2.0:1788837637.739662:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6167:x1875732012734080:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837637.740099:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6167:x1875732012734080:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 438us (627us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788837637.740108:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 206 00010000:00010000:3.0:1788837637.816910:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837638.588117:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036903552:0@lo:13: 00000100:00100000:2.0:1788837638.588236:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837638.588332:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036903552 00000100:00100000:1.0:1788837638.588340:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036903552 00000100:00100000:1.0:1788837638.588400:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788837638.588409:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036903552:12345-0@lo:13: 00002000:00000024:1.0:1788837638.588447:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837638.588495:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036903552:12345-0@lo:13: Request processed in 87us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837638.588502:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788837638.588541:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3729180 x1875732036903552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837638.588571:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036903552:0@lo:13: 00000100:00080000:2.0:1788837638.588616:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837638.588671:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036903680:0@lo:13: 00000100:00100000:2.0:1788837638.588699:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837638.588809:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036903680 00000100:00100000:1.0:1788837638.588814:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036903680 00000100:00100000:1.0:1788837638.588841:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788837638.588847:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036903680:12345-0@lo:13: 00002000:00000024:1.0:1788837638.588858:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788837638.593207:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837638.597982:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036903680:12345-0@lo:13: Request processed in 9124us (9272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837638.597999:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788837638.605917:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3728000 x1875732036903680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837638.605946:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036903680:0@lo:13: 00000020:00000080:3.0:1788837638.638867:0:10390:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce1bcd020 20000000:00000080:3.0:1788837638.638887:0:10390:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8899c269c800 uarg=0000000000000000 20000000:01000000:3.0:1788837638.638937:0:10390:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788837638.638944:0:10390:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788837638.638949:0:10390:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788837638.640152:0:10391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788837638.640283:0:10390:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788837638.649180:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788837638.649230:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788837638.649251:0:10390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788837638.649270:0:10390:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788837638.649290:0:10390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837638.649308:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889b02044200/0x57f6d4e926aeecf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeecee expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837638.649316:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ad8ac7e00/0x57f6d4e926aeed03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeecfc expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837638.649323:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889b02171600/0x57f6d4e926aeed57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeed50 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837638.649330:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aeee7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeee76 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837638.649340:0:10390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa790400/0x57f6d4e926aeef95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e902 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837638.649363:0:10390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837638.649406:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa790400/0x57f6d4e926aeef95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e902 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837638.650852:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889afa790400/0x57f6d4e926aeef95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e902 expref: 9 pid: 6519 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837638.650872:0:10390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875732036903808:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837638.651053:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aeee7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeee76 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837638.651063:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aeee7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeee76 expref: 14 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837638.651072:0:10390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875732036903936:0@lo:104: 00000100:00100000:3.0:1788837638.651112:0:10390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837638.651145:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889b02171600/0x57f6d4e926aeed57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeed50 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837638.651153:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889b02171600/0x57f6d4e926aeed57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeed50 expref: 14 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837638.651161:0:10390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3729c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875732036904064:0@lo:104: 00000100:00100000:3.0:1788837638.651185:0:10390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837638.651207:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ad8ac7e00/0x57f6d4e926aeed03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeecfc expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837638.651242:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ad8ac7e00/0x57f6d4e926aeed03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeecfc expref: 14 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837638.651250:0:10390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875732036904192:0@lo:104: 00010000:00010000:3.0:1788837638.651277:0:10390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889b02044200/0x57f6d4e926aeecf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeecee expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837638.651284:0:10390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889b02044200/0x57f6d4e926aeecf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeecee expref: 14 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837638.651291:0:10390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875732036904320:0@lo:104: 00000100:00100000:3.0:1788837638.651308:0:10390:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adf4eaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837638.652350:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788837638.652379:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837638.652399:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837638.652410:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036903936 00000100:00100000:1.0:1788837638.652483:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036903936 00000100:00100000:1.0:1788837638.652525:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036904064 00000100:00100000:1.0:1788837638.652529:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036904064 00000100:00100000:1.0:1788837638.652539:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036904192 00000100:00100000:1.0:1788837638.652541:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036904192 00000100:00100000:1.0:1788837638.652856:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036904320 00000100:00100000:1.0:1788837638.652860:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036904320 00000100:00100000:1.0:1788837638.652879:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788837638.652888:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+6:10390:x1875732036903936:12345-0@lo:104: 00010000:00010000:1.0:1788837638.652904:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeee7d expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837638.653020:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788837638.653027:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+6:10390:x1875732036903936:12345-0@lo:104: Request processed in 141us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837638.653034:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788837638.653052:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788837638.653057:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c270f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+5:10390:x1875732036904064:12345-0@lo:104: 00010000:00010000:1.0:1788837638.653064:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeed57 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837638.653101:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788837638.653106:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c270f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+5:10390:x1875732036904064:12345-0@lo:104: Request processed in 49us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837638.653112:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1788837638.653142:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1788837638.653149:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1788837638.653149:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeee7d expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653156:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dbc00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837638.653161:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeee7d expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837638.653166:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:10390:x1875732036904192:12345-0@lo:104: 00010000:00010000:0.0:1788837638.653169:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeee7d expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837638.653173:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeed03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837638.653177:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeee7d expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837638.653192:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788837638.653198:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788837638.653202:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:10390:x1875732036904192:12345-0@lo:104: Request processed in 38us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837638.653208:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788837638.653231:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788837638.653235:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee7d expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837638.653237:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:10390:x1875732036904320:12345-0@lo:104: 00010000:00010000:0.0:1788837638.653242:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837638.653244:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889b02045800/0x57f6d4e926aeecee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeecf5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653262:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee7d expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837638.653268:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1788837638.653270:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aeee76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeee7d expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837638.653273:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:10390:x1875732036904320:12345-0@lo:104: Request processed in 36us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837638.653278:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788837638.653283:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788837638.653286:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeed57 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653292:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0030600 already unused, calling callback (ffffffffc122ac20) 00010000:00010000:1.0:1788837638.653295:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:0.0:1788837638.653295:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeed57 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653301:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeed57 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837638.653307:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeed57 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837638.653312:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837638.653324:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeed57 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653330:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837638.653347:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeed57 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653353:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac0030600/0x57f6d4e926aeed50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeed57 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653362:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837638.653365:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889b02045800/0x57f6d4e926aeecee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeecf5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653371:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889b02045800 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837638.653373:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889b02045800/0x57f6d4e926aeecee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeecf5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837638.653378:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036904576:0@lo:103: 00010000:00010000:0.0:1788837638.653380:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889b02045800/0x57f6d4e926aeecee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeecf5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837638.653385:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889b02045800/0x57f6d4e926aeecee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeecf5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837638.653390:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837638.653401:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889b02045800/0x57f6d4e926aeecee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeecf5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653406:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788837638.653407:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837638.653411:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889b02045800/0x57f6d4e926aeecee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeecf5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653417:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889b02045800/0x57f6d4e926aeecee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeecf5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837638.653436:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788837638.653438:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837638.653442:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036904704:0@lo:103: 00010000:00010000:0.0:1788837638.653445:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837638.653446:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837638.653461:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837638.653462:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036904448:0@lo:103: 00000100:00100000:0.0:1788837638.653486:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837638.653510:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036904576 00000100:00100000:0.0:1788837638.653513:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036904576 00010000:00010000:0.0:1788837638.653531:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889b02171600/0x57f6d4e926aeed57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeed50 expref: 15 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837638.653551:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036904704 00000100:00100000:0.0:1788837638.653555:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036904704 00010000:00010000:0.0:1788837638.653565:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889b02044200/0x57f6d4e926aeecf5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeecee expref: 16 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837638.653568:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837638.653574:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aeed03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837638.653574:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036904448 00000100:00100000:0.0:1788837638.653577:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036904448 00010000:00010000:1.0:1788837638.653582:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac6000 already unused, calling callback (ffffffffc122ac20) 00010000:00010000:0.0:1788837638.653585:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aeee7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeee76 expref: 17 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837638.653589:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aeed03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837638.653595:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1788837638.653597:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aeed03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837638.653600:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:3650:x1875732036904576:12345-0@lo:103: 10000000:00010000:1.0:1788837638.653604:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aeed03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837638.653609:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837638.653609:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837638.653614:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889b02171600/0x57f6d4e926aeed57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeed50 expref: 17 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653622:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889b02171600/0x57f6d4e926aeed57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeed50 expref: 17 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837638.653625:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeed03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837638.653630:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837638.653637:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeed03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653639:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837638.653643:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926aeecfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aeed03 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837638.653667:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837638.653669:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837638.653671:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837638.653675:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837638.653677:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837638.653684:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:3650:x1875732036904576:12345-0@lo:103: Request processed in 84us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837638.653699:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788837638.653720:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788837638.653726:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:3650:x1875732036904704:12345-0@lo:103: 00010000:00010000:0.0:1788837638.653733:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837638.653737:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889b02044200/0x57f6d4e926aeecf5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeecee expref: 16 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653745:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889b02044200/0x57f6d4e926aeecf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeecee expref: 16 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653754:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837638.653759:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036904832:0@lo:103: 00000100:00100000:0.0:1788837638.653790:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:3650:x1875732036904704:12345-0@lo:103: Request processed in 49us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837638.653796:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788837638.653808:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788837638.653813:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2512680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:3649:x1875732036904448:12345-0@lo:103: 00000100:00100000:2.0:1788837638.653815:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837638.653820:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837638.653824:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aeee7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeee76 expref: 15 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653832:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aeee7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeee76 expref: 15 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653840:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837638.653861:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2512680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:3649:x1875732036904448:12345-0@lo:103: Request processed in 47us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837638.653866:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788837638.653876:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036904832 00000100:00100000:0.0:1788837638.653884:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036904832 00010000:00010000:0.0:1788837638.653895:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ad8ac7e00/0x57f6d4e926aeed03 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeecfc expref: 15 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837638.653908:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788837638.653914:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:3648:x1875732036904832:12345-0@lo:103: 00010000:00010000:0.0:1788837638.653920:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837638.653924:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ad8ac7e00/0x57f6d4e926aeed03 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeecfc expref: 15 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653931:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ad8ac7e00/0x57f6d4e926aeed03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeecfc expref: 15 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.653940:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837638.653971:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:3648:x1875732036904832:12345-0@lo:103: Request processed in 58us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837638.653977:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788837638.654018:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036904832:0@lo:103: 00000100:00100000:0.0:1788837638.654023:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036904704:0@lo:103: 00000100:00100000:0.0:1788837638.654030:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036904576:0@lo:103: 00000100:00100000:0.0:1788837638.654054:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036904448:0@lo:103: 00010000:00010000:3.0:1788837638.654156:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aeee7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeee76 expref: 14 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837638.654166:0:10390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875732036903936:0@lo:104: 00010000:00010000:3.0:1788837638.654718:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889b02171600/0x57f6d4e926aeed57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeed50 expref: 13 pid: 6519 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837638.654729:0:10390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3729c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875732036904064:0@lo:104: 00010000:00010000:3.0:1788837638.654739:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ad8ac7e00/0x57f6d4e926aeed03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeecfc expref: 12 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837638.654748:0:10390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875732036904192:0@lo:104: 00010000:00010000:3.0:1788837638.654757:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889b02044200/0x57f6d4e926aeecf5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeecee expref: 11 pid: 6516 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837638.654766:0:10390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875732036904320:0@lo:104: 00000100:00100000:0.0:1788837638.658122:0:10390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10390:1875732036903808:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837638.658164:0:10390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837638.659483:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837638.659745:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012734208 00000100:00100000:0.0:1788837638.659753:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012734208 00010000:00010000:0.0:1788837638.659847:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa790400/0x57f6d4e926aeef95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e902 expref: 10 pid: 6519 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837638.659905:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:0.0:1788837638.659915:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2396:x1875732012734208:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837638.659930:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837638.659936:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa790400/0x57f6d4e926aeef95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e902 expref: 10 pid: 6519 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.659948:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa790400/0x57f6d4e926aeef95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e902 expref: 10 pid: 6519 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.659966:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa790400/0x57f6d4e926aeef95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e902 expref: 10 pid: 6519 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.659980:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.659988:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.660003:0:9528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.660010:0:9528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.660016:0:9528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.660022:0:9528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.660038:0:9528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16e00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837638.660042:0:9528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.660048:0:9528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.660066:0:9528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.660076:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837638.660127:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:2396:x1875732012734208:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 213us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837638.660134:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 39 00010000:00010000:3.0:1788837638.660293:0:10390:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837638.660301:0:10390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837638.660308:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b16e00/0x57f6d4e926aeefdb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837638.841062:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788837639.130431:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788837639.130439:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ae7ed4800 from 48 10000000:01000000:3.0:1788837639.130445:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788837639.130575:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.130587:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.130598:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837639.130621:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036904960:0@lo:101: 00000100:00100000:3.0:1788837639.130685:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.130794:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adf4eaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837639.131034:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036904960 00000100:00100000:1.0:1788837639.131042:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036904960 00000100:00100000:1.0:1788837639.131193:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788837639.131202:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+11:6521:x1875732036904960:12345-0@lo:101: 00010000:00010000:1.0:1788837639.131226:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837639.131251:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c8a00/0x57f6d4e926aeefe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeefe2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.131275:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c8a00/0x57f6d4e926aeefe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeefe2 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.131285:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c8a00/0x57f6d4e926aeefe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeefe2 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.131294:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8a00, rc 0) 00000100:00100000:1.0:1788837639.131342:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6521:x1875732036904960:12345-0@lo:101: Request processed in 141us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837639.131349:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788837639.131422:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036904960:0@lo:101: 00010000:00010000:3.0:1788837639.131437:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeefe9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.131446:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeefe9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837639.131526:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036905088:0@lo:501: 00000100:00100000:3.0:1788837639.131554:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.132191:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adf4eaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.136717:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036905088 00000100:00100000:0.0:1788837639.136732:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036905088 00000100:00100000:2.0:1788837639.137011:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788837639.137022:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6521:x1875732036905088:12345-0@lo:501: 00000100:00100000:2.0:1788837639.137359:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6521:x1875732036905088:12345-0@lo:501: Request processed in 337us (5803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837639.137367:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788837639.137585:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036905088:0@lo:501: 00000100:00100000:0.0:1788837639.137633:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036905216:0@lo:503: 00000100:00100000:0.0:1788837639.137685:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837639.137723:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3341e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837639.137771:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036905216 00000100:00100000:1.0:1788837639.137804:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036905216 00000100:00100000:1.0:1788837639.137837:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788837639.137844:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6521:x1875732036905216:12345-0@lo:503: 00000100:00100000:1.0:1788837639.137928:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6521:x1875732036905216:12345-0@lo:503: Request processed in 84us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837639.137935:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788837639.138176:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036905216:0@lo:503: 00000100:00100000:1.0:1788837639.141958:0:10406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10406:1875732036905344:0@lo:502: 00000100:00100000:1.0:1788837639.142089:0:10406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837639.142146:0:10406:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad88c1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837639.142390:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036905344 00000100:00100000:2.0:1788837639.142396:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036905344 00000100:00100000:2.0:1788837639.142576:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788837639.142586:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:10406:x1875732036905344:12345-0@lo:502: 00000100:00100000:2.0:1788837639.142706:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:10406:x1875732036905344:12345-0@lo:502: Request processed in 122us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837639.142720:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788837639.142923:0:10406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10406:1875732036905344:0@lo:502: 00000100:00100000:1.0:1788837639.142970:0:10406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10406:1875732036905472:0@lo:502: 00000100:00100000:1.0:1788837639.143006:0:10406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837639.143034:0:10406:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac3803900 going to sleep for 11 seconds 00000100:00100000:2.0:1788837639.143582:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036905472 00000100:00100000:2.0:1788837639.143588:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036905472 00000100:00100000:2.0:1788837639.143632:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788837639.143642:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:10406:x1875732036905472:12345-0@lo:502: 00000100:00100000:2.0:1788837639.143734:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:10406:x1875732036905472:12345-0@lo:502: Request processed in 94us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837639.143742:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788837639.143934:0:10406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10406:1875732036905472:0@lo:502: 00000040:00080000:1.0:1788837639.143959:0:10406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788837639.144123:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788837639.144144:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788837639.144153:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeefe9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.144164:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeefe9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837639.144172:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788837639.144175:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788837639.144178:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788837639.144201:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.144219:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.144229:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837639.144244:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036905600:0@lo:101: 00000100:00100000:2.0:1788837639.144284:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.144348:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac841d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.155652:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036905600 00000100:00100000:0.0:1788837639.155667:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036905600 00000100:00100000:1.0:1788837639.155898:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788837639.155909:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+12:6521:x1875732036905600:12345-0@lo:101: 00010000:00010000:1.0:1788837639.155925:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837639.155944:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c9400/0x57f6d4e926aeeff7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeff0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.155972:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c9400/0x57f6d4e926aeeff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeff0 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.155983:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c9400/0x57f6d4e926aeeff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeff0 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.155992:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9400, rc 0) 00000100:00100000:1.0:1788837639.156069:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:6521:x1875732036905600:12345-0@lo:101: Request processed in 161us (11783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837639.156075:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788837639.156186:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036905600:0@lo:101: 00010000:00010000:2.0:1788837639.156214:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeff7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.156224:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeff7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837639.156296:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036905728:0@lo:501: 00000100:00100000:2.0:1788837639.156329:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.156369:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac841d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837639.156431:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036905728 00000100:00100000:1.0:1788837639.156436:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036905728 00000100:00100000:1.0:1788837639.156468:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788837639.156474:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:6521:x1875732036905728:12345-0@lo:501: 00000100:00100000:1.0:1788837639.156711:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:6521:x1875732036905728:12345-0@lo:501: Request processed in 237us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837639.156719:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788837639.156816:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036905728:0@lo:501: 00000100:00100000:2.0:1788837639.156844:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036905856:0@lo:503: 00000100:00100000:2.0:1788837639.156886:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.156904:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac841d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788837639.156916:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036905856 00000100:00100000:2.0:1788837639.156919:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036905856 00000100:00100000:2.0:1788837639.156942:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788837639.156948:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:6521:x1875732036905856:12345-0@lo:503: 00000100:00100000:2.0:1788837639.157028:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:6521:x1875732036905856:12345-0@lo:503: Request processed in 80us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837639.157035:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788837639.157069:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036905856:0@lo:503: 00000100:00100000:2.0:1788837639.157323:0:10408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10408:1875732036905984:0@lo:502: 00000100:00100000:2.0:1788837639.157364:0:10408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.157383:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036905984 00000100:00100000:2.0:1788837639.157387:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036905984 00000100:00100000:2.0:1788837639.157404:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788837639.157618:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:10408:x1875732036905984:12345-0@lo:502: 00000100:00100000:2.0:1788837639.157693:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:10408:x1875732036905984:12345-0@lo:502: Request processed in 282us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837639.157699:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788837639.157734:0:10408:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac841dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837639.157747:0:10408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10408:1875732036905984:0@lo:502: 00000020:01000000:2.0:1788837639.157767:0:10408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837639.157811:0:10408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837639.157814:0:10408:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788837639.157819:0:10408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788837639.157842:0:10408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10408:1875732036906112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837639.157875:0:10408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.157894:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036906112 00000100:00100000:2.0:1788837639.157898:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036906112 00000100:00100000:2.0:1788837639.157915:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788837639.157920:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:10408:x1875732036906112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837639.157971:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:10408:x1875732036906112:12345-0@lo:502:llog_process_th.0 Request processed in 50us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837639.157977:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788837639.158004:0:10408:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac841dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837639.158015:0:10408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10408:1875732036906112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837639.158032:0:10408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837639.158040:0:10408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837639.158042:0:10408:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788837639.158045:0:10408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1788837639.158093:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788837639.158109:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788837639.158118:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeff7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.158127:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeff7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837639.158136:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788837639.158139:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ae7ed4800 from 4 10000000:01000000:2.0:1788837639.158141:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837639.158164:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.158172:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.158180:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837639.158193:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036906240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.159672:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.159710:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac841dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.159853:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036906240 00000100:00100000:0.0:1788837639.159860:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036906240 00000100:00100000:0.0:1788837639.159916:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788837639.159925:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+13:6521:x1875732036906240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837639.159939:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837639.159972:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa790000/0x57f6d4e926aef005 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aeeffe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.160001:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa790000/0x57f6d4e926aef005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aeeffe expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.160014:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa790000/0x57f6d4e926aef005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeffe expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.160022:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790000, rc 0) 00000100:00100000:0.0:1788837639.160079:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:6521:x1875732036906240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.160086:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788837639.160132:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036906240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837639.160147:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef005 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.160155:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef005 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837639.160229:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036906368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.160258:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837639.160278:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c33419c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.161556:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036906368 00000100:00100000:0.0:1788837639.161567:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036906368 00000100:00100000:0.0:1788837639.161609:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788837639.161618:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:6521:x1875732036906368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.161768:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:6521:x1875732036906368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.161798:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788837639.161846:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036906368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.161889:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036906496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.161932:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837639.161956:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c33419c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.161968:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036906496 00000100:00100000:0.0:1788837639.161971:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036906496 00000100:00100000:0.0:1788837639.161988:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788837639.161993:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:6521:x1875732036906496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.162058:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:6521:x1875732036906496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.162064:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788837639.162099:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036906496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.162298:0:10409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10409:1875732036906624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837639.162333:0:10409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837639.162349:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036906624 00000100:00100000:0.0:1788837639.162353:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036906624 00000100:00100000:0.0:1788837639.162372:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788837639.162378:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:10409:x1875732036906624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837639.162728:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:10409:x1875732036906624:12345-0@lo:502:llog_process_th.0 Request processed in 349us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.162735:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788837639.162765:0:10409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3341a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.162807:0:10409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10409:1875732036906624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837639.162845:0:10409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837639.162853:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837639.162856:0:10409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788837639.162862:0:10409:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ae7ed4800 00000020:00000080:0.0:1788837639.162864:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788837639.162930:0:10409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10409:1875732036906752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837639.162962:0:10409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837639.162980:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036906752 00000100:00100000:0.0:1788837639.162984:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036906752 00000100:00100000:0.0:1788837639.163004:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788837639.163011:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:10409:x1875732036906752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837639.163069:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:10409:x1875732036906752:12345-0@lo:502:llog_process_th.0 Request processed in 58us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.163075:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788837639.163109:0:10409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3341a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.163121:0:10409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10409:1875732036906752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837639.163137:0:10409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837639.163141:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837639.163143:0:10409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788837639.163146:0:10409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788837639.163197:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788837639.163226:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837639.163236:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef005 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.163246:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef005 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837639.163265:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788837639.163267:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889afa550800 from 48 10000000:01000000:0.0:1788837639.163270:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788837639.163292:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.163300:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.163309:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837639.163322:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036906880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.163348:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837639.163360:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3341a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.163371:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036906880 00000100:00100000:0.0:1788837639.163374:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036906880 00000100:00100000:0.0:1788837639.163394:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788837639.163400:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+14:6521:x1875732036906880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837639.163407:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837639.166697:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa791c00/0x57f6d4e926aef013 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef00c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.166736:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa791c00/0x57f6d4e926aef013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef00c expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.166749:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa791c00/0x57f6d4e926aef013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef00c expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.166771:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791c00, rc 0) 00000100:00100000:0.0:1788837639.166868:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036906880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3467us (3518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.166877:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788837639.166958:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036906880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837639.166977:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef013 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.166987:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef013 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837639.167059:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036907008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.167090:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837639.167119:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3341a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.167132:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036907008 00000100:00100000:0.0:1788837639.167137:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036907008 00000100:00100000:0.0:1788837639.167170:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788837639.167178:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036907008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.167301:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036907008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.167308:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788837639.167336:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036907008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.167360:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036907136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.167397:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837639.170612:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3341a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.170639:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036907136 00000100:00100000:0.0:1788837639.170646:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036907136 00000100:00100000:0.0:1788837639.170696:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788837639.170704:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036907136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.170863:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036907136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (3464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.170872:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788837639.170939:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036907136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837639.171684:0:10412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10412:1875732036907264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837639.171736:0:10412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837639.171787:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036907264 00000100:00100000:1.0:1788837639.171793:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036907264 00000100:00100000:1.0:1788837639.171821:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788837639.171829:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:10412:x1875732036907264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837639.171919:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:10412:x1875732036907264:12345-0@lo:502:llog_process_th.0 Request processed in 91us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837639.171925:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788837639.171960:0:10412:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac9699600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837639.171972:0:10412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10412:1875732036907264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837639.172009:0:10412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10412:1875732036907392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837639.172038:0:10412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837639.172055:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036907392 00000100:00100000:1.0:1788837639.172059:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036907392 00000100:00100000:1.0:1788837639.172080:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788837639.172085:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:10412:x1875732036907392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837639.172138:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:10412:x1875732036907392:12345-0@lo:502:llog_process_th.0 Request processed in 52us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837639.172144:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788837639.172169:0:10412:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837639.172180:0:10412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10412:1875732036907392:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788837639.172196:0:10412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788837639.172262:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788837639.172281:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788837639.172291:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef013 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.172312:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef013 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837639.172322:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788837639.172325:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788837639.172328:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788837639.172352:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.172360:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.172369:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837639.172382:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036907520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788837639.172407:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837639.172432:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24e5540 going to sleep for 11 seconds 00000100:00100000:1.0:1788837639.172444:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036907520 00000100:00100000:1.0:1788837639.172447:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036907520 00000100:00100000:1.0:1788837639.172467:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788837639.172473:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+15:6521:x1875732036907520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837639.172482:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837639.172494:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c9e00/0x57f6d4e926aef021 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef01a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.172515:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c9e00/0x57f6d4e926aef021 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef01a expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.172536:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c9e00/0x57f6d4e926aef021 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef01a expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.172545:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9e00, rc 0) 00000100:00100000:1.0:1788837639.172574:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036907520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837639.172580:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788837639.172611:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036907520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837639.172623:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef021 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.172631:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef021 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837639.172671:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036907648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837639.172692:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837639.172704:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24e5540 going to sleep for 11 seconds 00000100:00100000:1.0:1788837639.172715:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036907648 00000100:00100000:1.0:1788837639.172718:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036907648 00000100:00100000:1.0:1788837639.172738:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788837639.172744:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036907648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837639.172850:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036907648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837639.172857:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788837639.172885:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036907648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837639.172915:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036907776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837639.172946:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837639.172957:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24e5540 going to sleep for 11 seconds 00000100:00100000:1.0:1788837639.172968:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036907776 00000100:00100000:1.0:1788837639.172972:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036907776 00000100:00100000:1.0:1788837639.172990:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788837639.172996:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036907776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837639.173062:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036907776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837639.173069:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788837639.173103:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036907776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.178127:0:10413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10413:1875732036907904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837639.178224:0:10413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837639.178269:0:10413:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3341600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837639.178929:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036907904 00000100:00100000:1.0:1788837639.178937:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036907904 00000100:00100000:1.0:1788837639.178994:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788837639.179003:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:10413:x1875732036907904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837639.181293:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:10413:x1875732036907904:12345-0@lo:502:llog_process_th.0 Request processed in 2280us (3059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837639.181307:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788837639.185259:0:10413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10413:1875732036907904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837639.185323:0:10413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837639.185333:0:10413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837639.185335:0:10413:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788837639.185341:0:10413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788837639.185376:0:10413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10413:1875732036908032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837639.185447:0:10413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837639.185485:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036908032 00000100:00100000:0.0:1788837639.185491:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036908032 00000100:00100000:0.0:1788837639.185537:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788837639.185545:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:10413:x1875732036908032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837639.185650:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:10413:x1875732036908032:12345-0@lo:502:llog_process_th.0 Request processed in 105us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.185658:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788837639.185708:0:10413:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae30240 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.185721:0:10413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10413:1875732036908032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837639.185739:0:10413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837639.185743:0:10413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837639.185745:0:10413:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788837639.185748:0:10413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1788837639.185993:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788837639.186016:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788837639.186026:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef021 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.186037:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef021 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837639.186058:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788837639.186060:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889afa550800 from 4 10000000:01000000:1.0:1788837639.186063:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788837639.186149:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.186157:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.186165:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837639.186178:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036908160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788837639.186221:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837639.186248:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24e5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.186295:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036908160 00000100:00100000:0.0:1788837639.186300:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036908160 00000100:00100000:0.0:1788837639.188182:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788837639.188198:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+16:6521:x1875732036908160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837639.188223:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837639.188241:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa791400/0x57f6d4e926aef02f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef028 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.188270:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa791400/0x57f6d4e926aef02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef028 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.188281:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa791400/0x57f6d4e926aef02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef028 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.188292:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791400, rc 0) 00000100:00100000:0.0:1788837639.188355:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036908160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.188363:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788837639.192883:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036908160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837639.192913:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef02f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.192927:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef02f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837639.193011:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036908288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837639.193078:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837639.193117:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24e5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.195915:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036908288 00000100:00100000:0.0:1788837639.195929:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036908288 00000100:00100000:0.0:1788837639.195989:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788837639.195998:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036908288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.196169:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036908288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (3090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.196183:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788837639.196318:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036908288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.196365:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036908416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.196409:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.196452:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac841dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.196563:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036908416 00000100:00100000:0.0:1788837639.196567:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036908416 00000100:00100000:0.0:1788837639.196630:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788837639.196637:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036908416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.196719:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036908416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.196726:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788837639.196803:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036908416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.196967:0:10416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10416:1875732036908544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837639.196998:0:10416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.201406:0:10416:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac841d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837639.201749:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036908544 00000100:00100000:1.0:1788837639.201760:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036908544 00000100:00100000:1.0:1788837639.201848:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788837639.201858:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:10416:x1875732036908544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837639.202015:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:10416:x1875732036908544:12345-0@lo:502:llog_process_th.0 Request processed in 158us (5016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837639.202023:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788837639.202192:0:10416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10416:1875732036908544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837639.202238:0:10416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837639.202247:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837639.202249:0:10416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788837639.202256:0:10416:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889afa550800 00000020:00000080:2.0:1788837639.202258:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788837639.203794:0:10416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10416:1875732036908672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837639.203876:0:10416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.203926:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036908672 00000100:00100000:2.0:1788837639.203934:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036908672 00000100:00100000:2.0:1788837639.203984:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788837639.203993:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:10416:x1875732036908672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837639.204124:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:10416:x1875732036908672:12345-0@lo:502:llog_process_th.0 Request processed in 132us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837639.204139:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788837639.204183:0:10416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c254b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788837639.204223:0:10416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10416:1875732036908672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837639.204248:0:10416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837639.204261:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837639.204264:0:10416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788837639.204268:0:10416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788837639.204352:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788837639.204381:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837639.204390:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef02f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.204407:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef02f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837639.204417:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788837639.204425:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ae7d4b000 from 48 10000000:01000000:2.0:1788837639.204428:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788837639.204459:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.204467:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.204477:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837639.204496:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036908800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.204530:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.204551:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c254b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788837639.204564:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036908800 00000100:00100000:2.0:1788837639.204567:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036908800 00000100:00100000:2.0:1788837639.204593:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788837639.204606:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+17:6521:x1875732036908800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837639.204615:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837639.204627:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6db200/0x57f6d4e926aef03d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef036 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.204664:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6db200/0x57f6d4e926aef03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef036 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.204682:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6db200/0x57f6d4e926aef03d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef036 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.204690:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6db200, rc 0) 00000100:00100000:2.0:1788837639.204734:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036908800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837639.204741:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788837639.204772:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036908800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837639.204812:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.204828:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837639.204887:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036908928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.204918:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.204926:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c254b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788837639.204948:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036908928 00000100:00100000:2.0:1788837639.204952:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036908928 00000100:00100000:2.0:1788837639.204967:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788837639.204977:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036908928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.205071:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036908928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837639.205086:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788837639.205115:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036908928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.210063:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036909056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.210183:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.210269:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c254b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.218321:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036909056 00000100:00100000:0.0:1788837639.218337:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036909056 00000100:00100000:0.0:1788837639.218405:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788837639.218416:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036909056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.218580:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036909056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (8398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.218588:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788837639.218652:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036909056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.222468:0:10419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10419:1875732036909184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837639.222549:0:10419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.222597:0:10419:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35780 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.223403:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036909184 00000100:00100000:0.0:1788837639.223412:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036909184 00000100:00100000:0.0:1788837639.223466:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788837639.223475:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:10419:x1875732036909184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837639.223603:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:10419:x1875732036909184:12345-0@lo:502:llog_process_th.0 Request processed in 129us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.223611:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788837639.223700:0:10419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10419:1875732036909184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837639.223745:0:10419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10419:1875732036909312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837639.223801:0:10419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.223824:0:10419:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35780 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.223879:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036909312 00000100:00100000:0.0:1788837639.223883:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036909312 00000100:00100000:0.0:1788837639.223913:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788837639.223920:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:10419:x1875732036909312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837639.223982:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:10419:x1875732036909312:12345-0@lo:502:llog_process_th.0 Request processed in 62us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.223989:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788837639.224057:0:10419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10419:1875732036909312:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788837639.224074:0:10419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788837639.225243:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788837639.225269:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788837639.225279:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.225291:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837639.225300:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788837639.225302:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1788837639.225305:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788837639.225334:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.225342:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.225353:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837639.225371:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036909440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.225416:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837639.225442:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa521d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837639.225528:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036909440 00000100:00100000:2.0:1788837639.225533:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036909440 00000100:00100000:2.0:1788837639.225566:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788837639.225574:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+18:6521:x1875732036909440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837639.225585:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837639.225597:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6da600/0x57f6d4e926aef04b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef044 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.225621:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6da600/0x57f6d4e926aef04b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef044 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.225645:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6da600/0x57f6d4e926aef04b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef044 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.225654:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6da600, rc 0) 00000100:00100000:2.0:1788837639.225690:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:6521:x1875732036909440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837639.225697:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788837639.225835:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036909440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837639.225858:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.225868:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837639.225922:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036909568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.225947:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837639.225968:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036909568 00000100:00100000:0.0:1788837639.225972:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036909568 00000100:00100000:0.0:1788837639.226001:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788837639.226010:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:6521:x1875732036909568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.226125:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:6521:x1875732036909568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.226132:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788837639.226156:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa521d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.226167:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036909568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.226191:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036909696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.226238:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837639.226256:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036909696 00000100:00100000:0.0:1788837639.226260:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036909696 00000100:00100000:0.0:1788837639.226279:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788837639.226284:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:6521:x1875732036909696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.226347:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:6521:x1875732036909696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.226353:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788837639.226391:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa521d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.226406:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036909696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.231758:0:10421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10421:1875732036909824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837639.231860:0:10421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.231916:0:10421:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adf4ea780 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.232270:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036909824 00000100:00100000:0.0:1788837639.232279:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036909824 00000100:00100000:0.0:1788837639.232330:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788837639.232340:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:10421:x1875732036909824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837639.232473:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:10421:x1875732036909824:12345-0@lo:502:llog_process_th.0 Request processed in 133us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.232481:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788837639.238801:0:10421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10421:1875732036909824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788837639.238849:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837639.238859:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837639.238861:0:10421:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788837639.238867:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788837639.239157:0:10421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10421:1875732036909952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837639.240938:0:10421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.240992:0:10421:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adf4ea780 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.242033:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036909952 00000100:00100000:0.0:1788837639.242044:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036909952 00000100:00100000:0.0:1788837639.242101:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788837639.242110:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:10421:x1875732036909952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837639.242263:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:10421:x1875732036909952:12345-0@lo:502:llog_process_th.0 Request processed in 153us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.242271:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788837639.242690:0:10421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10421:1875732036909952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788837639.242725:0:10421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837639.242733:0:10421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837639.242735:0:10421:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788837639.242739:0:10421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1788837639.242974:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788837639.242996:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788837639.243007:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.243018:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837639.243028:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788837639.243030:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ae7d4b000 from 4 10000000:01000000:1.0:1788837639.243033:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788837639.243063:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.243071:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837639.243079:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837639.243096:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036910080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788837639.243135:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837639.243169:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24e56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.243176:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036910080 00000100:00100000:3.0:1788837639.243183:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036910080 00000100:00100000:3.0:1788837639.243244:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788837639.243254:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:6521:x1875732036910080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837639.243264:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837639.243278:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef059 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef052 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.243310:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef059 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef052 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.243323:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef059 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef052 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.243332:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17e00, rc 0) 00000100:00100000:3.0:1788837639.243371:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036910080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.243378:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788837639.244486:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036910080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837639.244508:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef059 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.244518:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef059 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837639.244695:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036910208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.244737:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.244802:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35540 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.244987:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036910208 00000100:00100000:3.0:1788837639.244993:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036910208 00000100:00100000:3.0:1788837639.245035:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788837639.245044:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036910208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.245242:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036910208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.245249:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788837639.245453:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036910208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.245483:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036910336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.245525:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.245551:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35540 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.245566:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036910336 00000100:00100000:3.0:1788837639.245572:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036910336 00000100:00100000:3.0:1788837639.245616:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788837639.245624:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036910336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.245814:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036910336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.245822:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788837639.246124:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036910336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.246503:0:10423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10423:1875732036910464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837639.246546:0:10423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.246573:0:10423:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.246583:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036910464 00000100:00100000:3.0:1788837639.246589:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036910464 00000100:00100000:3.0:1788837639.246627:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788837639.246634:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:10423:x1875732036910464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837639.246828:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:10423:x1875732036910464:12345-0@lo:502:llog_process_th.0 Request processed in 193us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.246835:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788837639.246992:0:10423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10423:1875732036910464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837639.247013:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837639.247021:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837639.247024:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788837639.247031:0:10423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ae7d4b000 00000020:00000080:2.0:1788837639.247033:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788837639.247113:0:10423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10423:1875732036910592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837639.247150:0:10423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.247175:0:10423:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.247187:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036910592 00000100:00100000:3.0:1788837639.247192:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036910592 00000100:00100000:3.0:1788837639.247382:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788837639.247389:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:10423:x1875732036910592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837639.247476:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:10423:x1875732036910592:12345-0@lo:502:llog_process_th.0 Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.247482:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788837639.248477:0:10423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10423:1875732036910592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837639.248506:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837639.248513:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837639.248515:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788837639.248520:0:10423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788837639.248924:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788837639.248944:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837639.248954:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef059 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.248965:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef059 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837639.248975:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788837639.248978:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ac3ec4000 from 48 10000000:01000000:2.0:1788837639.248981:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788837639.249009:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.249017:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.249026:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837639.249043:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036910720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.249087:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.249125:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.249327:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036910720 00000100:00100000:3.0:1788837639.249333:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036910720 00000100:00100000:3.0:1788837639.249370:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788837639.249379:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036910720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837639.249389:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837639.249402:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b17400/0x57f6d4e926aef067 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef060 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.249504:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17400/0x57f6d4e926aef067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef060 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.249515:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b17400/0x57f6d4e926aef067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef060 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.249524:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17400, rc 0) 00000100:00100000:3.0:1788837639.249565:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036910720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.249572:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788837639.249611:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036910720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837639.249625:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.249634:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837639.249703:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036910848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.249854:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.249940:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036910848 00000100:00100000:3.0:1788837639.249945:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036910848 00000100:00100000:3.0:1788837639.249973:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788837639.249981:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036910848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.250162:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036910848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.250169:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788837639.250264:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adf4ea600 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.250280:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036910848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.250310:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036910976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.250348:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.250367:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036910976 00000100:00100000:3.0:1788837639.250371:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036910976 00000100:00100000:3.0:1788837639.250394:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788837639.250401:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036910976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.250597:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036910976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.250604:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788837639.250638:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adf4ea600 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.250651:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036910976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.251402:0:10424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10424:1875732036911104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837639.251640:0:10424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.251711:0:10424:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adf4eaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837639.251978:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036911104 00000100:00100000:2.0:1788837639.251985:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036911104 00000100:00100000:2.0:1788837639.254521:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788837639.254544:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:10424:x1875732036911104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837639.254741:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:10424:x1875732036911104:12345-0@lo:502:llog_process_th.0 Request processed in 209us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837639.254747:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788837639.255837:0:10424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10424:1875732036911104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837639.255959:0:10424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10424:1875732036911232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837639.256010:0:10424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.256044:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036911232 00000100:00100000:3.0:1788837639.257380:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036911232 00000100:00100000:3.0:1788837639.257506:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788837639.257516:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:10424:x1875732036911232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837639.257668:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:10424:x1875732036911232:12345-0@lo:502:llog_process_th.0 Request processed in 153us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.258038:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788837639.258173:0:10424:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f40300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.258213:0:10424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10424:1875732036911232:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788837639.258248:0:10424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788837639.258540:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788837639.258565:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788837639.258576:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.258588:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837639.258599:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788837639.258603:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1788837639.258606:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788837639.258638:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.258646:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.258657:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837639.258676:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036911360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.266934:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.266981:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35300 going to sleep for 11 seconds 00000100:00100000:0.0:1788837639.267460:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036911360 00000100:00100000:0.0:1788837639.267470:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036911360 00000100:00100000:0.0:1788837639.267527:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788837639.267536:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036911360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837639.267553:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837639.267571:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa791a00/0x57f6d4e926aef075 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef06e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.267596:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa791a00/0x57f6d4e926aef075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef06e expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.267625:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa791a00/0x57f6d4e926aef075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef06e expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837639.267634:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791a00, rc 0) 00000100:00100000:0.0:1788837639.267677:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036911360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.267684:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788837639.267842:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036911360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837639.267859:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.267869:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837639.268008:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036911488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.268036:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.268137:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded0b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788837639.275049:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036911488 00000100:00100000:1.0:1788837639.275430:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036911488 00000100:00100000:1.0:1788837639.275761:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788837639.275772:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036911488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837639.277149:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036911488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1373us (9105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837639.277162:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788837639.277185:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036911488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.277268:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036911616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.277321:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.277352:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded0b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788837639.277457:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036911616 00000100:00100000:2.0:1788837639.277469:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036911616 00000100:00100000:2.0:1788837639.277517:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788837639.277526:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036911616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.277701:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036911616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837639.277708:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788837639.277821:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036911616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.278605:0:10427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10427:1875732036911744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837639.278657:0:10427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.278849:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036911744 00000100:00100000:2.0:1788837639.278855:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036911744 00000100:00100000:2.0:1788837639.278897:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788837639.278904:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:10427:x1875732036911744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837639.279145:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:10427:x1875732036911744:12345-0@lo:502:llog_process_th.0 Request processed in 240us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837639.279152:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788837639.279334:0:10427:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded0b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.279359:0:10427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10427:1875732036911744:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788837639.279382:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837639.279390:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837639.279393:0:10427:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788837639.279398:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788837639.279434:0:10427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10427:1875732036911872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837639.279471:0:10427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.279495:0:10427:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded0b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788837639.279611:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036911872 00000100:00100000:2.0:1788837639.279615:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036911872 00000100:00100000:2.0:1788837639.279647:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788837639.279654:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:10427:x1875732036911872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837639.279750:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:10427:x1875732036911872:12345-0@lo:502:llog_process_th.0 Request processed in 96us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837639.279757:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788837639.279862:0:10427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10427:1875732036911872:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788837639.280001:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837639.280006:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837639.280008:0:10427:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788837639.280012:0:10427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788837639.280373:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1788837639.280394:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788837639.280404:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.280424:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837639.280446:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788837639.280450:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ac3ec4000 from 4 10000000:01000000:2.0:1788837639.280453:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837639.280482:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.280490:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.280499:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837639.280514:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036912000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.280552:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.280623:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.280948:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036912000 00000100:00100000:3.0:1788837639.280955:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036912000 00000100:00100000:3.0:1788837639.281035:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788837639.281045:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036912000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837639.281068:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837639.281083:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b16800/0x57f6d4e926aef083 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef07c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.281108:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b16800/0x57f6d4e926aef083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef07c expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.281118:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b16800/0x57f6d4e926aef083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef07c expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.281126:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16800, rc 0) 00000100:00100000:3.0:1788837639.281163:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036912000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.281177:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788837639.281370:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036912000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837639.281385:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef083 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837639.281394:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef083 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837639.281455:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036912128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.281482:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.281505:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.281594:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036912128 00000100:00100000:3.0:1788837639.281599:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036912128 00000100:00100000:3.0:1788837639.281625:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788837639.281631:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036912128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.282185:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036912128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 551us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.282192:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788837639.282341:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036912128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.282374:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036912256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837639.282491:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.282518:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.282571:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036912256 00000100:00100000:3.0:1788837639.282576:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036912256 00000100:00100000:3.0:1788837639.282642:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788837639.282650:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036912256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.283338:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036912256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 686us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.283345:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788837639.283391:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036912256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.283994:0:10428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10428:1875732036912384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837639.284027:0:10428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.284173:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036912384 00000100:00100000:3.0:1788837639.284179:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036912384 00000100:00100000:3.0:1788837639.284259:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788837639.284268:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:10428:x1875732036912384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837639.284353:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:10428:x1875732036912384:12345-0@lo:502:llog_process_th.0 Request processed in 86us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.284369:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788837639.287853:0:10428:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded0b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788837639.287966:0:10428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10428:1875732036912384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837639.288009:0:10428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837639.288020:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837639.288022:0:10428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788837639.288031:0:10428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ac3ec4000 00000020:00000080:2.0:1788837639.288035:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788837639.288181:0:10428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10428:1875732036912512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837639.288260:0:10428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837639.288292:0:10428:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e35600 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.290234:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036912512 00000100:00100000:3.0:1788837639.290251:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036912512 00000100:00100000:3.0:1788837639.290318:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788837639.290330:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:10428:x1875732036912512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837639.291224:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:10428:x1875732036912512:12345-0@lo:502:llog_process_th.0 Request processed in 893us (2961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.291233:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788837639.291549:0:10428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:10428:1875732036912512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837639.291586:0:10428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837639.291595:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837639.291598:0:10428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788837639.291603:0:10428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788837639.291997:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788837639.292021:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837639.292033:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef083 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.292045:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef083 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837639.292067:0:6521:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788837639.292070:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff889ac85799b8 from 1 10000000:01000000:3.0:1788837639.292072:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788837639.292105:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aef08a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.292113:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aef08a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.292122:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aef08a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837639.292142:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3729f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036912640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.292196:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.292267:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036912640 00000100:00100000:3.0:1788837639.292273:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036912640 00000100:00100000:3.0:1788837639.292307:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788837639.292317:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036912640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837639.292328:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837639.292340:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b16400/0x57f6d4e926aef091 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef08a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.292362:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b16400/0x57f6d4e926aef091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef08a expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.292372:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b16400/0x57f6d4e926aef091 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef08a expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.292382:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16400, rc 0) 00000100:00100000:3.0:1788837639.292530:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036912640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.292538:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788837639.292582:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded0b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.292597:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3729f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036912640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837639.292612:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aef08a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef091 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.292622:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aef08a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef091 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837639.292684:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3729f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036912768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.292721:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837639.292755:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036912768 00000100:00100000:3.0:1788837639.292759:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036912768 00000100:00100000:3.0:1788837639.292812:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788837639.292820:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036912768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837639.293021:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036912768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (298us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788837639.293029:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788837639.293137:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded0b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837639.293151:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3729f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036912768:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788837639.293175:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788837639.293181:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aef08a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef091 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.293189:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aef08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef091 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837639.353568:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837639.353655:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012734336 00000100:00100000:3.0:1788837639.353665:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012734336 00000100:00100000:3.0:1788837639.353728:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 269 00000100:00100000:3.0:1788837639.353739:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:6167:x1875732012734336:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837639.353756:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837639.353773:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef098 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003e948 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.353835:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e948 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.353864:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e948 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837639.353874:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17800, rc 0) 00000100:00100000:3.0:1788837639.353930:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6167:x1875732012734336:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 193us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.353937:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 269 00000100:00100000:3.0:1788837639.370690:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837639.374418:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012734464 00000100:00100000:0.0:1788837639.374494:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012734464 00000100:00100000:0.0:1788837639.374574:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 270 00000100:00100000:0.0:1788837639.374582:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6167:x1875732012734464:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.374723:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6167:x1875732012734464:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 140us (4038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.374732:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 270 00000100:00100000:2.0:1788837639.377469:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837639.377611:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012734592 00000100:00100000:0.0:1788837639.377620:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012734592 00000100:00100000:0.0:1788837639.377678:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 271 00000100:00100000:0.0:1788837639.377687:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6167:x1875732012734592:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837639.377826:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6167:x1875732012734592:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 140us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.377833:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 271 00000100:00100000:1.0:1788837639.381238:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837639.381323:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012734720 00000100:00100000:3.0:1788837639.381332:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012734720 00000100:00100000:3.0:1788837639.381386:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 272 00000100:00100000:3.0:1788837639.381396:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6692:x1875732012734720:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837639.381552:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6692:x1875732012734720:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 156us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.381560:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 272 00000100:00100000:3.0:1788837639.384324:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837639.384421:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012734848 00000100:00100000:0.0:1788837639.384430:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012734848 00000100:00100000:0.0:1788837639.384486:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 273 00000100:00100000:0.0:1788837639.384497:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6692:x1875732012734848:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788837639.384618:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:6692:x1875732012734848:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 123us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.384624:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 273 00000100:00100000:1.0:1788837639.667538:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837639.667622:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837639.667666:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837639.668452:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012735360 00000100:00100000:3.0:1788837639.668463:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012735360 00000100:00100000:3.0:1788837639.668529:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:3.0:1788837639.668540:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012735360:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837639.668610:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012735360:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 72us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837639.668618:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00080000:3.0:1788837639.668643:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837639.679293:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837639.679332:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012735232 00000100:00100000:1.0:1788837639.679352:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012735232 00000100:00100000:1.0:1788837639.679413:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:1.0:1788837639.679423:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012735232:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837639.679491:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012735232:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837639.679498:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00080000:1.0:1788837639.679519:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837639.686457:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012735104 00000100:00100000:0.0:1788837639.686476:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012735104 00000100:00100000:0.0:1788837639.686562:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012734976 00000100:00100000:0.0:1788837639.686566:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012734976 00000100:00100000:0.0:1788837639.686597:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:0.0:1788837639.686608:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012735104:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837639.686704:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012735104:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 98us (19175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.686712:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:0.0:1788837639.686731:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:0.0:1788837639.686738:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2393:x1875732012734976:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837639.686766:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2393:x1875732012734976:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 28us (19099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837639.686772:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00080000:0.0:1788837639.686813:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837639.686817:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788837639.865001:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837640.124209:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036912896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837640.124317:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837640.124431:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036912896 00000100:00100000:0.0:1788837640.124445:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036912896 00000100:00100000:0.0:1788837640.124511:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788837640.124522:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036912896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837640.124584:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788837640.124641:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036912896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837640.124649:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788837640.124709:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036912896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837640.126039:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036913024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837640.126106:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837640.126177:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036913024 00000100:00100000:0.0:1788837640.126184:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036913024 00000100:00100000:0.0:1788837640.126250:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837640.126260:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036913024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837640.126292:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837640.126339:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036913024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837640.126359:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788837640.126383:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788837640.126428:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2513480 x1875732036913024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837656 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837640.126447:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036913024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837640.130024:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036913152:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.130118:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837640.130210:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036913152 00000100:00100000:2.0:1788837640.130220:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036913152 00000100:00100000:2.0:1788837640.130284:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788837640.130294:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036913152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.130353:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036913152:12345-0@lo:400:kworker.0 Request processed in 60us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837640.130361:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788837640.130430:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036913152:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.130484:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036913280:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.130518:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837640.130551:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036913280 00000100:00100000:2.0:1788837640.130555:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036913280 00000100:00100000:2.0:1788837640.130583:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788837640.130590:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036913280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.130627:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036913280:12345-0@lo:400:kworker.0 Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837640.130634:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788837640.130658:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036913280:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.130697:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036913408:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.130724:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837640.130752:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036913408 00000100:00100000:2.0:1788837640.130756:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036913408 00000100:00100000:2.0:1788837640.130804:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788837640.130812:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036913408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.130847:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036913408:12345-0@lo:400:kworker.0 Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837640.130854:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788837640.130884:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036913408:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.130915:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036913536:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.130941:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837640.130972:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036913536 00000100:00100000:2.0:1788837640.130991:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036913536 00000100:00100000:2.0:1788837640.131033:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788837640.131039:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036913536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.131073:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036913536:12345-0@lo:400:kworker.0 Request processed in 34us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837640.131079:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788837640.131096:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837640.131115:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036913536:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.131144:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036913664:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.131168:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837640.131202:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036913664 00000100:00100000:2.0:1788837640.131206:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036913664 00000100:00100000:2.0:1788837640.131232:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788837640.131238:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036913664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.131270:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036913664:12345-0@lo:400:kworker.0 Request processed in 32us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837640.131276:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788837640.131303:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6edf80 x1875732036913664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837640.131315:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036913664:0@lo:400:kworker.0 00000100:00080000:2.0:1788837640.131326:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837640.131349:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036913792:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.131374:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837640.131403:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036913792 00000100:00100000:2.0:1788837640.131406:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036913792 00000100:00100000:2.0:1788837640.131437:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788837640.131444:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036913792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.131487:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036913792:12345-0@lo:400:kworker.0 Request processed in 43us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837640.131495:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788837640.131523:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6edf80 x1875732036913792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837640.131534:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036913792:0@lo:400:kworker.0 00000100:00080000:2.0:1788837640.131546:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837640.131569:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036913920:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.131591:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837640.131618:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036913920 00000100:00100000:2.0:1788837640.131622:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036913920 00000100:00100000:2.0:1788837640.131652:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788837640.131658:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036913920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.131693:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036913920:12345-0@lo:400:kworker.0 Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837640.131699:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788837640.131717:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837640.131733:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6edf80 x1875732036913920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837640.131742:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036913920:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.131770:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036914048:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.131819:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837640.131844:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036914048 00000100:00100000:2.0:1788837640.131848:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036914048 00000100:00100000:2.0:1788837640.131873:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788837640.131887:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036914048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.131919:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036914048:12345-0@lo:400:kworker.0 Request processed in 33us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837640.131925:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788837640.131941:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837640.131956:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036914048:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.131983:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036914176:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.132007:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837640.132030:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036914176 00000100:00100000:2.0:1788837640.132034:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036914176 00000100:00100000:2.0:1788837640.132057:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788837640.132063:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036914176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.132095:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036914176:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837640.132101:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1788837640.132126:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6edf80 x1875732036914176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837640.132135:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036914176:0@lo:400:kworker.0 00000100:00080000:2.0:1788837640.132148:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837640.132174:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036914304:0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.132218:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837640.132244:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036914304 00000100:00100000:2.0:1788837640.132248:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036914304 00000100:00100000:2.0:1788837640.132273:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788837640.132278:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036914304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837640.132321:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036914304:12345-0@lo:400:kworker.0 Request processed in 42us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837640.132328:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788837640.132351:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6edf80 x1875732036914304/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837640.132361:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036914304:0@lo:400:kworker.0 00000100:00080000:2.0:1788837640.132373:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837640.136678:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036914432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837640.136810:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837640.137941:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036914432 00000100:00100000:0.0:1788837640.137957:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036914432 00000100:00100000:0.0:1788837640.138027:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788837640.138038:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036914432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788837640.138071:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837640.141093:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036914432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3042us (4268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837640.141135:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788837640.143261:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2513480 x1875732036914432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837656 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837640.143296:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036914432:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788837640.894330:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837641.145126:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837641.145161:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036914560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837641.145273:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837641.145391:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036914560 00000100:00100000:0.0:1788837641.145400:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036914560 00000100:00100000:0.0:1788837641.145465:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788837641.145477:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036914560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788837641.156002:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788837641.156351:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036914560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10870us (11072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837641.156364:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788837641.156666:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036914560:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788837641.915396:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837642.942697:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837643.709511:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036914688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837643.709889:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837643.711488:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036914816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837643.711582:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837643.711731:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036914688 00000100:00100000:3.0:1788837643.711742:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036914688 00000100:00100000:3.0:1788837643.711833:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036914816 00000100:00100000:3.0:1788837643.711837:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036914816 00000100:00100000:3.0:1788837643.711860:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788837643.711869:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036914688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837643.711910:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837643.717751:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036914688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5864us (7845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837643.717798:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788837643.717853:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788837643.717871:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036914816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788837643.717908:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837643.717999:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036914816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (6418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837643.718006:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788837643.718303:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3729880 x1875732036914816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837643.718330:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036914816:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788837643.718686:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837643.722503:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3729500 x1875732036914688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837643.722541:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036914688:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788837643.960972:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837644.800056:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837644.800106:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012735488 00000100:00100000:0.0:1788837644.800121:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837644.800132:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012735488 00000100:00100000:0.0:1788837644.800156:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837644.800181:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837644.800208:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837644.800209:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 274 00000100:00100000:0.0:1788837644.800234:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012736000 00000100:00100000:0.0:1788837644.800238:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012736000 00000100:00100000:0.0:1788837644.800286:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012735872 00000100:00100000:0.0:1788837644.800289:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012735872 00000100:00100000:0.0:1788837644.800314:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:0.0:1788837644.800324:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012736000:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837644.800416:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012736000:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 94us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837644.800424:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:0.0:1788837644.800451:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:0.0:1788837644.800458:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012735872:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837644.800488:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012735872:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837644.800494:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:0.0:1788837644.800515:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012735744 00000100:00100000:0.0:1788837644.800518:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012735744 00000100:00100000:0.0:1788837644.800546:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012735616 00000100:00100000:0.0:1788837644.800549:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012735616 00000100:00100000:0.0:1788837644.800567:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:0.0:1788837644.800573:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012735744:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837644.800598:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012735744:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837644.800604:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:0.0:1788837644.800614:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:0.0:1788837644.800619:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:2394:x1875732012735616:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837644.800638:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:2394:x1875732012735616:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 19us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837644.800643:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00080000:0.0:1788837644.800679:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837644.800683:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788837644.800686:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837644.800688:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837644.807217:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2394:x1875732012735488:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837644.807361:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2394:x1875732012735488:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 7137us (7318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837644.807376:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 274 00010000:00010000:0.0:1788837644.985582:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837645.241017:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036914944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837645.241093:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837645.241183:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036914944 00000100:00100000:0.0:1788837645.241190:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036914944 00000100:00100000:0.0:1788837645.241243:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788837645.241252:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036914944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837645.241295:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837645.241340:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036914944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837645.241348:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788837645.241371:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788837645.241401:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2511180 x1875732036914944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837645.241420:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036914944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837645.241568:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036915072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837645.241598:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837645.241677:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036915072 00000100:00100000:3.0:1788837645.241682:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036915072 00000100:00100000:3.0:1788837645.241718:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788837645.241726:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036915072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788837645.241752:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788837645.241819:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036915072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837645.241825:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788837645.241895:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036915072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837645.243538:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036915200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837645.243596:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837645.243647:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036915200 00000100:00100000:0.0:1788837645.243652:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036915200 00000100:00100000:0.0:1788837645.243694:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788837645.243702:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036915200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788837645.243720:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837645.243757:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036915200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837645.243764:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788837645.243807:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788837645.243831:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2511500 x1875732036915200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837645.243847:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036915200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837645.244364:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036915584:0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.244399:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837645.244419:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036916096:0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.244445:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837645.244470:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788837645.244476:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036915712:0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.244499:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837645.244516:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036916224:0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.244536:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837645.244564:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036915584 00000100:00100000:1.0:1788837645.244568:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036915584 00000100:00100000:1.0:1788837645.244599:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788837645.244606:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036915584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.244645:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036915584:12345-0@lo:400:kworker.0 Request processed in 40us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837645.244653:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788837645.244672:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036916096 00000100:00100000:1.0:1788837645.244676:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036916096 00000100:00100000:1.0:1788837645.244704:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036916224 00000100:00100000:1.0:1788837645.244707:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036916224 00000100:00100000:1.0:1788837645.244727:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837645.244732:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036916096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.244771:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036916096:12345-0@lo:400:kworker.0 Request processed in 38us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837645.244796:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837645.244807:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837645.244813:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036916224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.244839:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036916224:12345-0@lo:400:kworker.0 Request processed in 27us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837645.244844:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837645.244860:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036915712 00000100:00100000:1.0:1788837645.244864:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036915712 00000100:00100000:1.0:1788837645.244887:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837645.244893:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036915712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.244920:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036915712:12345-0@lo:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837645.244926:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1788837645.244950:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837645.244975:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036915712:0@lo:400:kworker.0 00010000:00080000:1.0:1788837645.244985:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c41180 x1875732036916224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837645.244993:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036916224:0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245001:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036915584:0@lo:400:kworker.0 00010000:00080000:1.0:1788837645.245009:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c40000 x1875732036916096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837645.245018:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036916096:0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245048:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036915456:0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245072:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837645.245087:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732036915968:0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245119:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837645.245137:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732036916480:0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245155:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837645.245171:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788837645.245177:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036915328:0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245200:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837645.245219:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036915840:0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245237:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837645.245246:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036916352:0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245262:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837645.245281:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036915456 00000100:00100000:1.0:1788837645.245285:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036915456 00000100:00100000:1.0:1788837645.245301:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036915968 00000100:00100000:1.0:1788837645.245303:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036915968 00000100:00100000:1.0:1788837645.245321:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036916480 00000100:00100000:1.0:1788837645.245323:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036916480 00000100:00100000:1.0:1788837645.245335:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036915840 00000100:00100000:1.0:1788837645.245338:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036915840 00000100:00100000:1.0:1788837645.245347:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036916352 00000100:00100000:1.0:1788837645.245349:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036916352 00000100:00100000:1.0:1788837645.245362:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788837645.245367:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036915456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245400:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036915456:12345-0@lo:400:kworker.0 Request processed in 32us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837645.245416:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788837645.245427:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788837645.245433:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732036915968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245460:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732036915968:12345-0@lo:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837645.245465:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788837645.245475:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788837645.245480:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732036916480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245501:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732036916480:12345-0@lo:400:kworker.0 Request processed in 21us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837645.245507:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788837645.245516:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788837645.245521:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036915840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245543:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036915840:12345-0@lo:400:kworker.0 Request processed in 22us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837645.245549:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788837645.245559:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788837645.245564:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036916352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245586:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036916352:12345-0@lo:400:kworker.0 Request processed in 22us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837645.245591:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788837645.245603:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837645.245606:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837645.245625:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036915840:0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245643:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036916352:0@lo:400:kworker.0 00000100:00100000:1.0:1788837645.245652:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036915456:0@lo:400:kworker.0 00010000:00080000:1.0:1788837645.245661:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c42d80 x1875732036915968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837645.245670:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732036915968:0@lo:400:kworker.0 00010000:00080000:1.0:1788837645.245679:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c43100 x1875732036916480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837645.245687:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732036916480:0@lo:400:kworker.0 00000100:00100000:0.0:1788837645.245812:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036915328 00000100:00100000:0.0:1788837645.245817:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036915328 00000100:00100000:0.0:1788837645.245847:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788837645.245855:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036915328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837645.245890:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036915328:12345-0@lo:400:kworker.0 Request processed in 37us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837645.245897:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788837645.245932:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036915328:0@lo:400:kworker.0 00000001:02000400:1.0:1788837645.340342:0:10702:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788837646.008955:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837646.265285:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837646.265310:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036916608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837646.265383:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837646.265447:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036916608 00000100:00100000:0.0:1788837646.265455:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036916608 00000100:00100000:0.0:1788837646.265501:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788837646.265510:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036916608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837646.265544:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788837646.265590:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036916608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837646.265597:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788837646.265646:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036916608:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788837647.033918:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837648.057048:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837648.825970:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036916736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837648.826052:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837648.826150:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036916736 00000100:00100000:3.0:1788837648.826158:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036916736 00000100:00100000:3.0:1788837648.826677:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837648.826687:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036916736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837648.826728:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837648.826810:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2511500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036916736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837648.826817:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837648.826879:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036916864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837648.826908:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788837648.826963:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c372ad80 x1875732036916736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837648.826983:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036916736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837648.827013:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036916864 00000100:00100000:3.0:1788837648.827017:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036916864 00000100:00080000:0.0:1788837648.829686:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837648.830214:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788837648.830228:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036916864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788837648.830254:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837648.830333:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036916864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (3425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837648.830341:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788837648.834888:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c372a680 x1875732036916864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837648.834917:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036916864:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788837649.082335:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837649.915250:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837649.915298:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837649.915332:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837649.915355:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837649.915379:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837649.915407:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012736512 00000100:00100000:1.0:1788837649.915417:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012736512 00000100:00100000:1.0:1788837649.915475:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012736640 00000100:00100000:1.0:1788837649.915479:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012736640 00000100:00100000:1.0:1788837649.915502:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:1.0:1788837649.915512:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012736512:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837649.915585:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012736512:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 75us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837649.915611:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:1.0:1788837649.915629:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:1.0:1788837649.915636:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012736640:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837649.915664:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012736640:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837649.915670:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:1.0:1788837649.915687:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012736128 00000100:00100000:1.0:1788837649.915690:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012736128 00000100:00100000:1.0:1788837649.915715:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 276 00000100:00100000:1.0:1788837649.915721:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2394:x1875732012736128:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837649.915745:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2394:x1875732012736128:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837649.915751:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 276 00000100:00100000:1.0:1788837649.915799:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012736256 00000100:00100000:1.0:1788837649.915803:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012736256 00000100:00100000:1.0:1788837649.915829:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012736384 00000100:00100000:1.0:1788837649.915832:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012736384 00000100:00100000:1.0:1788837649.915850:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 76 00000100:00100000:1.0:1788837649.915856:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:2394:x1875732012736256:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837649.915884:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:2394:x1875732012736256:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 28us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837649.915891:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 76 00000100:00100000:1.0:1788837649.915902:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 77 00000100:00100000:1.0:1788837649.915907:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012736384:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837649.915938:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012736384:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 31us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837649.915945:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 77 00000100:00080000:1.0:1788837649.915963:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837649.915966:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837649.915969:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837649.915971:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788837650.106108:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837650.361130:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036917120:0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.361198:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837650.361256:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036917632:0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.361278:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837650.361301:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036918144:0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.361320:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837650.361341:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788837650.361346:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036917248:0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.361370:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837650.361387:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036917760:0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.361407:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837650.361422:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036918272:0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.361440:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837650.361465:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036917120 00000100:00100000:1.0:1788837650.361472:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036917120 00000100:00100000:1.0:1788837650.361507:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036917632 00000100:00100000:1.0:1788837650.361510:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036917632 00000100:00100000:1.0:1788837650.361532:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036918144 00000100:00100000:1.0:1788837650.361535:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036918144 00000100:00100000:1.0:1788837650.361556:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036917760 00000100:00100000:1.0:1788837650.361559:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036917760 00000100:00100000:1.0:1788837650.361570:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036918272 00000100:00100000:1.0:1788837650.361572:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036918272 00000100:00100000:1.0:1788837650.361586:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788837650.361593:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036917120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.361641:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036917120:12345-0@lo:400:kworker.0 Request processed in 47us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837650.361648:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788837650.361665:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837650.361671:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036917632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.361697:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036917632:12345-0@lo:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837650.361702:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837650.361712:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788837650.361716:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036918144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.361742:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036918144:12345-0@lo:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837650.361748:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788837650.361758:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788837650.361764:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036917760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.361814:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036917760:12345-0@lo:400:kworker.0 Request processed in 50us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837650.361821:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788837650.361831:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788837650.361837:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036918272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.361870:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036918272:12345-0@lo:400:kworker.0 Request processed in 34us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837650.361876:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788837650.361900:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036917248 00000100:00100000:1.0:1788837650.361904:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036917248 00000100:00100000:1.0:1788837650.361928:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788837650.361935:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036917248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.361965:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036917248:12345-0@lo:400:kworker.0 Request processed in 31us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837650.361971:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788837650.361988:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837650.361992:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837650.362031:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036917248:0@lo:400:kworker.0 00010000:00080000:1.0:1788837650.362046:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c31b6d80 x1875732036917760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837650.362056:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036917760:0@lo:400:kworker.0 00010000:00080000:1.0:1788837650.362064:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c35d5500 x1875732036918272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837650.362072:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036918272:0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.362080:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036917120:0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.362087:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036917632:0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.362095:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036918144:0@lo:400:kworker.0 00000100:00100000:3.0:1788837650.362230:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036916992:0@lo:400:kworker.0 00000100:00100000:3.0:1788837650.362263:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837650.362297:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036917504:0@lo:400:kworker.0 00000100:00100000:3.0:1788837650.362320:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837650.362338:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036918016:0@lo:400:kworker.0 00000100:00100000:3.0:1788837650.362361:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837650.362377:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036918528:0@lo:400:kworker.0 00000100:00100000:3.0:1788837650.362397:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837650.362414:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788837650.362420:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036917376:0@lo:400:kworker.0 00000100:00100000:3.0:1788837650.362438:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837650.362451:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036917888:0@lo:400:kworker.0 00000100:00100000:3.0:1788837650.362468:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837650.362482:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036918400:0@lo:400:kworker.0 00000100:00100000:3.0:1788837650.362501:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837650.362555:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036917504 00000100:00100000:3.0:1788837650.362559:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036917504 00000100:00100000:3.0:1788837650.362589:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788837650.362595:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036917504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837650.362635:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036917504:12345-0@lo:400:kworker.0 Request processed in 40us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837650.362641:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788837650.362767:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036917504:0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.363174:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036916992 00000100:00100000:1.0:1788837650.363185:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036916992 00000100:00100000:1.0:1788837650.363220:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788837650.363227:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036916992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.363300:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036916992:12345-0@lo:400:kworker.0 Request processed in 73us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837650.363306:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788837650.363335:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036918016 00000100:00100000:1.0:1788837650.363338:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036918016 00000100:00100000:1.0:1788837650.363364:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036918528 00000100:00100000:1.0:1788837650.363367:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036918528 00000100:00100000:1.0:1788837650.363379:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036917888 00000100:00100000:1.0:1788837650.363382:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036917888 00000100:00100000:1.0:1788837650.363392:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036918400 00000100:00100000:1.0:1788837650.363395:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036918400 00000100:00100000:1.0:1788837650.363406:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788837650.363411:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036918016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.363440:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036918016:12345-0@lo:400:kworker.0 Request processed in 29us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837650.363446:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788837650.363457:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788837650.363462:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036918528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.363490:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036918528:12345-0@lo:400:kworker.0 Request processed in 28us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837650.363495:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788837650.363507:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788837650.363512:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036917888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.363537:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036917888:12345-0@lo:400:kworker.0 Request processed in 25us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837650.363548:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788837650.363558:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788837650.363563:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af76fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036918400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.363590:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af76fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036918400:12345-0@lo:400:kworker.0 Request processed in 27us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837650.363596:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788837650.363739:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837650.363743:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837650.363916:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036917376 00000100:00100000:1.0:1788837650.363920:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036917376 00000100:00100000:1.0:1788837650.363944:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788837650.363949:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036917376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.363979:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036917376:12345-0@lo:400:kworker.0 Request processed in 30us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837650.363985:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788837650.364088:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036917376:0@lo:400:kworker.0 00010000:00080000:2.0:1788837650.364103:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c31b7b80 x1875732036917888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837650.364114:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036917888:0@lo:400:kworker.0 00010000:00080000:2.0:1788837650.364124:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c35d5880 x1875732036918400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837650.364132:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036918400:0@lo:400:kworker.0 00000100:00100000:2.0:1788837650.364140:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036916992:0@lo:400:kworker.0 00010000:00080000:2.0:1788837650.364160:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c31b5180 x1875732036918016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837650.364168:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036918016:0@lo:400:kworker.0 00010000:00080000:2.0:1788837650.364178:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c35d7b80 x1875732036918528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837650.364184:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036918528:0@lo:400:kworker.0 00000100:00100000:1.0:1788837650.365116:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036918784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837650.365161:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837650.365232:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837650.365238:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036918656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837650.365259:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837650.365525:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036918912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837650.365554:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837650.369534:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036918912 00000100:00100000:1.0:1788837650.369549:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036918912 00000100:00100000:1.0:1788837650.369604:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788837650.369614:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036918912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788837650.369648:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788837650.369713:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036918912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (4158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837650.369733:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788837650.369804:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036918912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837650.373874:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036918784 00000100:00100000:2.0:1788837650.373893:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036918784 00000100:00100000:3.0:1788837650.380147:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036918656 00000100:00100000:3.0:1788837650.380163:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036918656 00000100:00100000:3.0:1788837650.380229:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788837650.380242:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036918784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837650.380277:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837650.380376:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036918784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (15213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837650.380383:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788837650.380434:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2513800 x1875732036918784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837650.380456:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036918784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837650.380483:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788837650.380491:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036918656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788837650.380502:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837650.380533:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036918656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (15273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837650.380539:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788837650.380575:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2510700 x1875732036918656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837650.380588:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036918656:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1788837650.875965:0:10946:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing yml_node 00010000:00010000:1.0:1788837651.135589:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837651.386677:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036919040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837651.386754:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837651.386893:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036919040 00000100:00100000:3.0:1788837651.386900:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036919040 00000100:00100000:3.0:1788837651.386954:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788837651.386963:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036919040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837651.387008:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788837651.387058:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036919040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837651.387065:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788837651.387188:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036919040:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788837652.153265:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837653.177047:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837653.945169:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837653.945205:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036919168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837653.945273:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837653.945510:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036919168 00000100:00100000:3.0:1788837653.945527:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036919168 00000100:00100000:3.0:1788837653.945587:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788837653.945597:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036919168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788837653.945625:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837653.945672:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036919168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837653.945679:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788837653.945803:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837653.945841:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3729c00 x1875732036919168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837653.945860:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036919168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837653.946057:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036919296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837653.946095:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837653.946295:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036919296 00000100:00100000:3.0:1788837653.946300:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036919296 00000100:00100000:3.0:1788837653.946342:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788837653.946350:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036919296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837653.946361:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837653.946418:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036919296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837653.946425:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788837653.946860:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837653.946885:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2510000 x1875732036919296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837653.946901:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036919296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788837654.201061:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837655.034167:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837655.034206:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837655.034225:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837655.034251:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837655.036015:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012736896 00000100:00100000:1.0:1788837655.036029:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012736896 00000100:00100000:1.0:1788837655.036114:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012737024 00000100:00100000:1.0:1788837655.036118:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012737024 00000100:00100000:1.0:1788837655.036151:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 84 00000100:00100000:3.0:1788837655.036161:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 85 00000100:00100000:1.0:1788837655.036163:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2393:x1875732012736896:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837655.036176:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012737024:12345-192.168.201.3@tcp:400:kworker.0 00000100:00080000:2.0:1788837655.036250:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837655.036266:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837655.036300:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012736768 00000100:00100000:2.0:1788837655.036305:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012736768 00000100:00100000:2.0:1788837655.036336:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 278 00000100:00100000:2.0:1788837655.036343:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2393:x1875732012736768:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837655.036400:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2393:x1875732012736896:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 241us (2243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837655.036408:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 84 00000100:00100000:1.0:1788837655.036431:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012737152 00000100:00100000:1.0:1788837655.036434:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012737152 00000100:00100000:1.0:1788837655.036465:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:1.0:1788837655.036472:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2392:x1875732012737152:12345-192.168.201.3@tcp:9:kworker.0 00000020:00000080:1.0:1788837655.036497:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeefaa 00000100:00080000:1.0:1788837655.036506:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8899c3240800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837655.036548:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788837655.037094:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012737024:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 920us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837655.037103:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 85 00000100:00080000:3.0:1788837655.037336:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788837655.037494:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837655.038269:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837655.038311:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012737280 00000100:00100000:3.0:1788837655.038319:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012737280 00000100:00100000:3.0:1788837655.038367:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:3.0:1788837655.038378:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2392:x1875732012737280:12345-192.168.201.3@tcp:9:kworker.0 00000020:00000080:3.0:1788837655.038410:0:8544:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeefb1 00000100:00080000:3.0:1788837655.038420:0:8544:0:(import.c:65:import_set_state_nolock()) ffff8899c3245000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788837655.038746:0:8544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788837655.038927:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+2:2392:x1875732012737280:12345-192.168.201.3@tcp:9:kworker.0 Request processed in 549us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837655.038947:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00080000:3.0:1788837655.038969:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788837655.039111:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837655.041903:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2393:x1875732012736768:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 5540us (7676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837655.041917:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 278 00000100:00100000:1.0:1788837655.042108:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+2:2392:x1875732012737152:12345-192.168.201.3@tcp:9:kworker.0 Request processed in 5634us (7853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837655.042118:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00010000:00010000:1.0:1788837655.225304:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837655.480972:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837655.480996:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036919424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837655.481083:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837655.481146:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036919424 00000100:00100000:1.0:1788837655.481153:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036919424 00000100:00100000:1.0:1788837655.481197:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837655.481205:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036919424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788837655.481239:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788837655.481283:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036919424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837655.481290:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837655.481335:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036919424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837655.481539:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036919808:0@lo:400:kworker.0 00000100:00100000:2.0:1788837655.481570:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837655.481589:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036920320:0@lo:400:kworker.0 00000100:00100000:2.0:1788837655.481611:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837655.481628:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036920832:0@lo:400:kworker.0 00000100:00100000:2.0:1788837655.481645:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837655.481663:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788837655.481668:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036919680:0@lo:400:kworker.0 00000100:00100000:2.0:1788837655.481692:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837655.481709:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036920192:0@lo:400:kworker.0 00000100:00100000:2.0:1788837655.481748:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837655.481765:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036920704:0@lo:400:kworker.0 00000100:00100000:2.0:1788837655.481812:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837655.481841:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036920320 00000100:00100000:2.0:1788837655.481845:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036920320 00000100:00100000:2.0:1788837655.481880:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036920832 00000100:00100000:2.0:1788837655.481883:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036920832 00000100:00100000:2.0:1788837655.481905:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788837655.481919:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036920320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837655.481970:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036920320:12345-0@lo:400:kworker.0 Request processed in 53us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837655.481978:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788837655.481993:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788837655.481999:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036920832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837655.482024:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036920832:12345-0@lo:400:kworker.0 Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837655.482029:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788837655.482048:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036919680 00000100:00100000:2.0:1788837655.482051:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036919680 00000100:00100000:2.0:1788837655.482073:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036920192 00000100:00100000:2.0:1788837655.482076:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036920192 00000100:00100000:2.0:1788837655.482087:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036920704 00000100:00100000:2.0:1788837655.482089:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036920704 00000100:00100000:2.0:1788837655.482101:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788837655.482106:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036919680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837655.482137:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036919680:12345-0@lo:400:kworker.0 Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837655.482142:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788837655.482154:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788837655.482158:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036920192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837655.482183:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036920192:12345-0@lo:400:kworker.0 Request processed in 25us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837655.482189:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788837655.482199:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788837655.482205:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036920704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837655.482237:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036920704:12345-0@lo:400:kworker.0 Request processed in 33us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837655.482243:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788837655.482263:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837655.482267:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837655.482269:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837655.482295:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036919680:0@lo:400:kworker.0 00010000:00080000:2.0:1788837655.482307:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6ec380 x1875732036920192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837655.482317:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036920192:0@lo:400:kworker.0 00010000:00080000:2.0:1788837655.482326:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27bce00 x1875732036920704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837655.482335:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036920704:0@lo:400:kworker.0 00010000:00080000:2.0:1788837655.482344:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6ed180 x1875732036920320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837655.482352:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036920320:0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.482546:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036919552:0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.482581:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837655.482608:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036920064:0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.482627:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837655.482641:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036920576:0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.482658:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837655.482674:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788837655.482680:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036919936:0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.482700:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837655.482715:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036920448:0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.482735:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837655.482751:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036920960:0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.482769:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837655.482807:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036919552 00000100:00100000:1.0:1788837655.482812:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036919552 00000100:00100000:1.0:1788837655.482850:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788837655.482856:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036919552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.482888:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036919552:12345-0@lo:400:kworker.0 Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837655.482894:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788837655.482931:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036920064 00000100:00100000:1.0:1788837655.482935:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036920064 00000100:00100000:1.0:1788837655.482959:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036920576 00000100:00100000:1.0:1788837655.482962:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036920576 00000100:00100000:1.0:1788837655.482974:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036919936 00000100:00100000:1.0:1788837655.482976:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036919936 00000100:00100000:1.0:1788837655.482987:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788837655.482992:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036920064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.483021:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036920064:12345-0@lo:400:kworker.0 Request processed in 28us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837655.483026:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788837655.483037:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788837655.483042:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036920576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837655.483166:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036919808 00000100:00100000:0.0:1788837655.483170:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036919808 00000100:00100000:0.0:1788837655.483197:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788837655.483204:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036919808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837655.483238:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036919808:12345-0@lo:400:kworker.0 Request processed in 35us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837655.483244:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1788837655.484556:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27bc700 x1875732036920832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837655.484570:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036920832:0@lo:400:kworker.0 00000100:00100000:2.0:1788837655.484607:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036919808:0@lo:400:kworker.0 00000100:00100000:0.0:1788837655.484752:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036921216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837655.484816:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837655.484857:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036921216 00000100:00100000:0.0:1788837655.484863:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036921216 00000100:00100000:0.0:1788837655.484902:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788837655.484910:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036921216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837655.484944:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837655.484982:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036921216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837655.484988:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788837655.485020:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2510700 x1875732036921216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837655.485032:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036921216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837655.485091:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837655.485105:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036921088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837655.485131:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837655.485253:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036921088 00000100:00100000:0.0:1788837655.485257:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036921088 00000100:00100000:0.0:1788837655.485292:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788837655.485299:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036921088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788837655.485308:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837655.485523:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036920576:12345-0@lo:400:kworker.0 Request processed in 2479us (2861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837655.485531:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788837655.485546:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788837655.485552:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036919936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.485580:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036919936:12345-0@lo:400:kworker.0 Request processed in 28us (2879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837655.485586:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788837655.485604:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036920448 00000100:00100000:1.0:1788837655.485614:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036920448 00000100:00100000:1.0:1788837655.485638:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036920960 00000100:00100000:1.0:1788837655.485642:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036920960 00000100:00100000:1.0:1788837655.485662:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788837655.485667:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036920448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.485697:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036920448:12345-0@lo:400:kworker.0 Request processed in 30us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837655.485703:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788837655.485713:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788837655.485718:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036920960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.485740:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036920960:12345-0@lo:400:kworker.0 Request processed in 23us (2970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837655.485745:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788837655.485770:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837655.485793:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837655.485796:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837655.485825:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036919936:0@lo:400:kworker.0 00010000:00080000:1.0:1788837655.485837:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6eea00 x1875732036920448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837655.485845:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036920448:0@lo:400:kworker.0 00010000:00080000:1.0:1788837655.485853:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27be300 x1875732036920960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837655.485860:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036920960:0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.485870:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036919552:0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.485879:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036920064:0@lo:400:kworker.0 00000100:00100000:1.0:1788837655.485901:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036920576:0@lo:400:kworker.0 00000100:00100000:0.0:1788837655.486086:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036921088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837655.486095:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788837655.486122:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2510000 x1875732036921088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837655.486134:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036921088:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1788837655.721753:0:11129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.112 00010000:00010000:0.0:1788837656.258236:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837656.509356:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837656.509379:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036921344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837656.509448:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837656.509547:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036921344 00000100:00100000:1.0:1788837656.509554:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036921344 00000100:00100000:1.0:1788837656.509609:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788837656.509618:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036921344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788837656.509650:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788837656.509700:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036921344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837656.509706:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788837656.509751:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036921344:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788837657.273035:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837658.297282:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788837658.509466:0:11227:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.112 00000100:00100000:2.0:1788837659.066106:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036921472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837659.066177:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837659.066242:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036921600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837659.066263:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837659.066554:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036921472 00000100:00100000:3.0:1788837659.066561:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036921472 00000100:00100000:3.0:1788837659.066656:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036921600 00000100:00100000:3.0:1788837659.066660:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036921600 00000100:00080000:1.0:1788837659.066682:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837659.066758:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837659.066771:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036921472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837659.066820:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837659.066878:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036921472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837659.066885:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837659.066903:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837659.066909:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036921600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837659.066919:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1788837659.066944:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2510000 x1875732036921472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837659.066948:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036921600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837659.066954:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788837659.066962:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036921472:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788837659.066973:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3729180 x1875732036921600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837659.066983:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036921600:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788837659.321990:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837660.148364:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837660.148410:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837660.148426:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012737408 00000100:00100000:0.0:1788837660.148436:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012737408 00000100:00100000:3.0:1788837660.148437:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837660.148457:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012737536 00000100:00100000:3.0:1788837660.148461:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012737536 00000100:00100000:0.0:1788837660.148484:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 280 00000100:00100000:0.0:1788837660.148493:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2393:x1875732012737408:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837660.148495:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012737664 00000100:00100000:3.0:1788837660.148497:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012737664 00000100:00100000:3.0:1788837660.148517:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 92 00000100:00100000:3.0:1788837660.148523:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:2394:x1875732012737536:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837660.148574:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2393:x1875732012737408:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837660.148582:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 280 00000100:00100000:2.0:1788837660.150328:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 93 00000100:00100000:2.0:1788837660.150346:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012737664:12345-192.168.201.3@tcp:400:kworker.0 00000100:00080000:0.0:1788837660.150838:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788837660.150855:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837660.157961:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:2394:x1875732012737536:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 9424us (9535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837660.157978:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 92 00000100:00100000:2.0:1788837660.163362:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012737664:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 13010us (14911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837660.163377:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 93 00010000:00010000:3.0:1788837660.345928:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837660.601454:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036921728:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.601529:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837660.601654:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036921728 00000100:00100000:1.0:1788837660.601662:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036921728 00000100:00100000:1.0:1788837660.601710:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788837660.601719:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036921728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837660.602020:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036921856:0@lo:400:kworker.0 00000100:00100000:3.0:1788837660.602062:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837660.602087:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837660.602092:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036921984:0@lo:400:kworker.0 00000100:00100000:3.0:1788837660.602116:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837660.602139:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036922112:0@lo:400:kworker.0 00000100:00100000:3.0:1788837660.602159:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837660.602182:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036921856 00000100:00100000:3.0:1788837660.602186:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036921856 00000100:00100000:3.0:1788837660.602228:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036922112 00000100:00100000:3.0:1788837660.602232:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036922112 00000100:00100000:3.0:1788837660.602254:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788837660.602261:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036921856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837660.602309:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036921856:12345-0@lo:400:kworker.0 Request processed in 48us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837660.602315:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788837660.602329:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788837660.602334:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036922112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837660.602359:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036922112:12345-0@lo:400:kworker.0 Request processed in 25us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837660.602364:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788837660.602396:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036922112:0@lo:400:kworker.0 00000100:00100000:3.0:1788837660.602424:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036921856:0@lo:400:kworker.0 00000100:00100000:3.0:1788837660.606033:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036921984 00000100:00100000:3.0:1788837660.606059:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036921984 00000100:00100000:3.0:1788837660.606128:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788837660.606138:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036921984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837660.606232:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036921984:12345-0@lo:400:kworker.0 Request processed in 95us (4114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837660.606239:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788837660.606300:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036921984:0@lo:400:kworker.0 00000100:00100000:1.0:1788837660.607157:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036921728:12345-0@lo:400:kworker.0 Request processed in 5436us (5625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837660.607168:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788837660.610097:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837660.610125:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036922240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837660.610190:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837660.610234:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036922240 00000100:00100000:0.0:1788837660.610242:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036922240 00000100:00100000:0.0:1788837660.610306:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788837660.610316:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036922240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837660.610344:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837660.610385:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036922240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837660.610392:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788837660.610412:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788837660.610442:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2510000 x1875732036922240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837660.610462:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036922240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837660.610631:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036921728:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.612824:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837660.612860:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036922368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837660.612925:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837660.613036:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036922368 00000100:00100000:0.0:1788837660.613102:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036922368 00000100:00100000:0.0:1788837660.613153:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788837660.613162:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036922368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837660.613192:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788837660.613231:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036922368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837660.613238:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788837660.613342:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036922368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837660.613420:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036922496:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.613443:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837660.613482:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036922624:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.613505:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837660.613542:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837660.613547:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036922752:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.613567:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837660.613600:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036922880:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.613624:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837660.613653:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036922880 00000100:00100000:0.0:1788837660.613656:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036922880 00000100:00100000:0.0:1788837660.613684:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788837660.613697:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036922880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.613732:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036922880:12345-0@lo:400:kworker.0 Request processed in 36us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837660.613738:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788837660.613770:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c337e300 x1875732036922880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837660.613842:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036922880:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.613875:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036923008:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.613899:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837660.613924:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036923008 00000100:00100000:0.0:1788837660.613928:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036923008 00000100:00100000:0.0:1788837660.616380:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837660.616400:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036923008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.616481:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036923008:12345-0@lo:400:kworker.0 Request processed in 90us (2581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837660.616489:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788837660.616535:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c337e300 x1875732036923008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837660.616548:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036923008:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.616617:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036923136:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.616653:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837660.616706:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837660.616712:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036923264:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.616734:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837660.616794:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036922624 00000100:00100000:0.0:1788837660.616800:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036922624 00000100:00100000:0.0:1788837660.616847:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036922752 00000100:00100000:0.0:1788837660.616850:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036922752 00000100:00100000:0.0:1788837660.616869:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036923136 00000100:00100000:0.0:1788837660.616872:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036923136 00000100:00100000:0.0:1788837660.616882:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036923264 00000100:00100000:0.0:1788837660.616885:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036923264 00000100:00100000:0.0:1788837660.616897:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788837660.616902:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036922624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.616939:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036922624:12345-0@lo:400:kworker.0 Request processed in 36us (3433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837660.617077:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036922496 00000100:00100000:3.0:1788837660.617082:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036922496 00000100:00100000:3.0:1788837660.617110:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788837660.617118:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036922496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837660.617164:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036922496:12345-0@lo:400:kworker.0 Request processed in 47us (3721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837660.617171:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788837660.617196:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788837660.617203:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036922752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837660.617233:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036922752:12345-0@lo:400:kworker.0 Request processed in 31us (3665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837660.617239:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788837660.617251:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788837660.617257:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036923136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837660.617292:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036923136:12345-0@lo:400:kworker.0 Request processed in 36us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837660.617297:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788837660.617308:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788837660.617314:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036923264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837660.617337:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036923264:12345-0@lo:400:kworker.0 Request processed in 24us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837660.617342:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788837660.617567:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1788837660.617586:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788837660.617590:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837660.617613:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036922496:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.617625:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837660.617631:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036923392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837660.617657:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788837660.617700:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c337ca80 x1875732036923264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837660.617710:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036923264:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.617720:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036923136:0@lo:400:kworker.0 00010000:00080000:0.0:1788837660.617728:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c337f800 x1875732036922752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837660.617737:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036922752:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.617746:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036922624:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.617818:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036923520:0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.617852:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837660.617878:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036923520 00000100:00100000:0.0:1788837660.617882:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036923520 00000100:00100000:0.0:1788837660.617912:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837660.617919:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036923520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837660.617964:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036923520:12345-0@lo:400:kworker.0 Request processed in 45us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837660.617970:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788837660.617983:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788837660.618000:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c337c000 x1875732036923520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837660.618009:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036923520:0@lo:400:kworker.0 00000100:00100000:3.0:1788837660.621279:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036923392 00000100:00100000:3.0:1788837660.621293:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036923392 00000100:00100000:3.0:1788837660.621347:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788837660.621357:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036923392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788837660.621380:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837660.621458:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036923392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (3800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837660.621476:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788837660.621524:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c372b800 x1875732036923392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837660.621544:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036923392:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1788837660.823487:0:11324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.112 00000001:00100000:0.0:1788837661.123674:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3a879e24-3b2f-4404-84c2-9101689d9315 00000020:00000080:0.0:1788837661.123686:0:8433:0:(genops.c:885:class_export_put()) final put ffff8899c3242000/3a879e24-3b2f-4404-84c2-9101689d9315 00000020:00000080:1.0:1788837661.123845:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3242000/3a879e24-3b2f-4404-84c2-9101689d9315 for lustre-OST0000 00000020:00000080:1.0:1788837661.123889:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c3240800 for lustre-OST0000 00000001:00100000:1.0:1788837661.129122:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3a879e24-3b2f-4404-84c2-9101689d9315 00000020:00000080:1.0:1788837661.129132:0:9519:0:(genops.c:885:class_export_put()) final put ffff8899c3247000/3a879e24-3b2f-4404-84c2-9101689d9315 00000020:00000080:0.0:1788837661.129233:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3247000/3a879e24-3b2f-4404-84c2-9101689d9315 for lustre-OST0001 00000020:00000080:0.0:1788837661.129288:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c3245000 for lustre-OST0001 00010000:00010000:1.0:1788837661.370608:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837661.626129:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837661.626152:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036923648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837661.626253:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837661.626702:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036923648 00000100:00100000:3.0:1788837661.626712:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036923648 00000100:00100000:3.0:1788837661.626853:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788837661.626863:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036923648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837661.626915:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788837661.626984:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036923648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837661.626991:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788837661.627074:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036923648:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788837662.395337:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788837662.486882:0:11372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 23:21:01 EDT 2026 00010000:00010000:3.0:1788837663.416940:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837664.186039:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036923776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837664.186112:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837664.186200:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036923776 00000100:00100000:2.0:1788837664.186208:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036923776 00000100:00100000:2.0:1788837664.186260:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788837664.186270:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036923776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837664.186298:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837664.186341:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036923776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837664.186360:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788837664.186381:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837664.186421:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c1c380 x1875732036923776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837664.186439:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036923776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837664.187819:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036923904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837664.187944:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837664.188004:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036923904 00000100:00100000:2.0:1788837664.188010:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036923904 00000100:00100000:2.0:1788837664.188056:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788837664.188064:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036923904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837664.188083:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837664.188120:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036923904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837664.188127:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788837664.188146:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837664.188168:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c1c380 x1875732036923904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837664.188689:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036923904:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788837664.445956:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837665.266868:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837665.267593:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837665.267678:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837665.267709:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012738048 00000100:00100000:3.0:1788837665.267721:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012738048 00000100:00100000:3.0:1788837665.267819:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012737920 00000100:00100000:3.0:1788837665.267823:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012737920 00000100:00100000:3.0:1788837665.267847:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 100 00000100:00100000:3.0:1788837665.267857:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012738048:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837665.267926:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012738048:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 71us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837665.267934:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 100 00000100:00100000:3.0:1788837665.267972:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 101 00000100:00100000:3.0:1788837665.267978:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012737920:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837665.268004:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012737920:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837665.268010:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 101 00000100:00080000:3.0:1788837665.268026:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837665.268030:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788837665.269106:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012737792 00000100:00100000:0.0:1788837665.269117:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012737792 00000100:00100000:0.0:1788837665.269168:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 282 00000100:00100000:0.0:1788837665.269176:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2395:x1875732012737792:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837665.269244:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2395:x1875732012737792:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 69us (2386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837665.269252:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 282 00010000:00010000:1.0:1788837665.465262:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837665.721028:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837665.724308:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036924672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837665.724335:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036924288:0@lo:400:kworker.0 00000100:00100000:1.0:1788837665.724511:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036924416:0@lo:400:kworker.0 00000100:00100000:3.0:1788837665.724567:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036924544:0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.726362:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837665.726439:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036925184:0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.726518:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837665.726537:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036925696:0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.726553:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837665.726568:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788837665.726574:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036925056:0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.726590:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837665.726605:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732036925568:0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.726623:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837665.726670:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036925184 00000100:00100000:0.0:1788837665.726678:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036925184 00000100:00100000:0.0:1788837665.726728:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036925696 00000100:00100000:0.0:1788837665.726730:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036925696 00000100:00100000:0.0:1788837665.726740:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036925056 00000100:00100000:0.0:1788837665.726742:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036925056 00000100:00100000:0.0:1788837665.726762:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036925568 00000100:00100000:0.0:1788837665.726765:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036925568 00000100:00100000:0.0:1788837665.726793:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788837665.726801:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036925184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.727192:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036925184:12345-0@lo:400:kworker.0 Request processed in 391us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837665.727199:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788837665.727215:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788837665.727221:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036925696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.727244:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036925696:12345-0@lo:400:kworker.0 Request processed in 24us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837665.727261:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788837665.727271:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788837665.727275:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036925056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.727296:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036925056:12345-0@lo:400:kworker.0 Request processed in 22us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837665.727301:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788837665.727309:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788837665.727313:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732036925568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.727391:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732036925568:12345-0@lo:400:kworker.0 Request processed in 76us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837665.727396:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1788837665.727418:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837665.727421:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788837665.727447:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036925056:0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.727455:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732036925568:0@lo:400:kworker.0 00010000:00080000:0.0:1788837665.727465:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa5ee300 x1875732036925184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837665.727473:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036925184:0@lo:400:kworker.0 00010000:00080000:0.0:1788837665.727480:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7e3ca80 x1875732036925696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837665.727486:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036925696:0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.727536:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036924672 00000100:00100000:0.0:1788837665.727539:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036924672 00000100:00100000:0.0:1788837665.727569:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788837665.727574:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036924672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837665.727600:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788837665.727633:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036924672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837665.727638:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788837665.727666:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036924672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837665.731349:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837665.731429:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036924160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837665.731492:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837665.731545:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036924800:0@lo:400:kworker.0 00000100:00100000:2.0:1788837665.731571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837665.731591:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036925312:0@lo:400:kworker.0 00000100:00100000:2.0:1788837665.731614:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837665.731635:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036925824:0@lo:400:kworker.0 00000100:00100000:2.0:1788837665.731656:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837665.731696:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036924160 00000100:00100000:2.0:1788837665.731704:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036924160 00000100:00100000:2.0:1788837665.731772:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788837665.731799:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036924160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837665.731831:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837665.731876:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036924160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837665.731884:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788837665.731907:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036925312 00000100:00100000:2.0:1788837665.731911:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036925312 00000100:00100000:2.0:1788837665.731934:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036925824 00000100:00100000:2.0:1788837665.731936:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036925824 00000100:00100000:2.0:1788837665.731955:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788837665.731961:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036925312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837665.731995:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036925312:12345-0@lo:400:kworker.0 Request processed in 34us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837665.732001:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788837665.732012:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788837665.732018:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036925824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837665.732045:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036925824:12345-0@lo:400:kworker.0 Request processed in 27us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837665.732057:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788837665.732098:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa5efb80 x1875732036925312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837665.732112:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036925312:0@lo:400:kworker.0 00010000:00080000:2.0:1788837665.732122:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7d42300 x1875732036925824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837665.732130:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036925824:0@lo:400:kworker.0 00010000:00080000:2.0:1788837665.732139:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c337e300 x1875732036924160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837665.732152:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036924160:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788837665.732827:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837665.732843:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036924800 00000100:00100000:2.0:1788837665.732849:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036924800 00000100:00100000:2.0:1788837665.732883:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788837665.732891:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036924800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837665.732938:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036924800:12345-0@lo:400:kworker.0 Request processed in 48us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837665.732945:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788837665.732974:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036924800:0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.733078:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036924288 00000100:00100000:0.0:1788837665.733083:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036924288 00000100:00100000:0.0:1788837665.733122:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788837665.733129:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036924288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.733179:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036924288:12345-0@lo:400:kworker.0 Request processed in 50us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837665.733186:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788837665.733329:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036924288:0@lo:400:kworker.0 00000100:00100000:1.0:1788837665.734313:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837665.734349:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036924928:0@lo:400:kworker.0 00000100:00100000:1.0:1788837665.734384:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837665.734414:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036925440:0@lo:400:kworker.0 00000100:00100000:1.0:1788837665.734438:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837665.734454:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036925952:0@lo:400:kworker.0 00000100:00100000:1.0:1788837665.734477:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837665.734571:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036924416 00000100:00100000:0.0:1788837665.734579:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036924416 00000100:00100000:0.0:1788837665.734626:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788837665.734635:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036924416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.734684:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036924416:12345-0@lo:400:kworker.0 Request processed in 52us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837665.734691:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788837665.734802:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036924928 00000100:00100000:2.0:1788837665.734806:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036924928 00000100:00100000:2.0:1788837665.734833:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788837665.734854:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036924928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837665.734891:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036924928:12345-0@lo:400:kworker.0 Request processed in 38us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837665.734897:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788837665.734915:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036925440 00000100:00100000:2.0:1788837665.734919:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036925440 00000100:00100000:2.0:1788837665.734940:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036925952 00000100:00100000:2.0:1788837665.734943:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036925952 00000100:00100000:2.0:1788837665.734961:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788837665.734968:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036925440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837665.735000:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036925440:12345-0@lo:400:kworker.0 Request processed in 32us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837665.735006:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788837665.735017:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788837665.735023:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036925952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837665.735050:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036925952:12345-0@lo:400:kworker.0 Request processed in 28us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837665.735056:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788837665.735265:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036924416:0@lo:400:kworker.0 00000100:00100000:1.0:1788837665.735275:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036924928:0@lo:400:kworker.0 00010000:00080000:1.0:1788837665.735286:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa5ef100 x1875732036925440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837665.735296:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036925440:0@lo:400:kworker.0 00010000:00080000:1.0:1788837665.735304:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7d42d80 x1875732036925952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837665.735311:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036925952:0@lo:400:kworker.0 00000100:00100000:3.0:1788837665.735509:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837665.735583:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036924032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837665.735612:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837665.738313:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036924032 00000100:00100000:2.0:1788837665.738329:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036924032 00000100:00100000:2.0:1788837665.738409:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788837665.738419:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036924032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837665.738446:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837665.738537:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036924032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (2924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837665.738544:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788837665.739330:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3344000 x1875732036924032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837665.739375:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036924032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837665.740346:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036924544 00000100:00100000:0.0:1788837665.740358:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036924544 00000100:00100000:0.0:1788837665.740469:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788837665.740480:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036924544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837665.740574:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036924544:12345-0@lo:400:kworker.0 Request processed in 95us (5064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837665.740593:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837665.740665:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036924544:0@lo:400:kworker.0 00010000:00010000:3.0:1788837666.488992:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837666.745314:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036926080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837666.745388:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837666.755995:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036926080 00000100:00100000:0.0:1788837666.756010:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036926080 00000100:00100000:0.0:1788837666.756074:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788837666.756084:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036926080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837666.756137:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788837666.756231:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036926080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (10842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837666.756238:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788837666.756300:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036926080:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788837667.514486:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837668.545643:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837669.312076:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036926208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837669.313072:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837669.314268:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036926208 00000100:00100000:3.0:1788837669.314280:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036926208 00000100:00080000:1.0:1788837669.314437:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837669.314469:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788837669.314482:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036926208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837669.314517:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837669.315265:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036926208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 783us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837669.315274:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788837669.317324:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837669.317342:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036926336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837669.317411:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837669.317459:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036926336 00000100:00100000:0.0:1788837669.317466:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036926336 00000100:00100000:0.0:1788837669.317510:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788837669.317518:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036926336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837669.317537:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837669.317573:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036926336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837669.317580:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788837669.317602:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788837669.317629:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c337fb80 x1875732036926336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837669.317646:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036926336:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788837669.319596:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c1ea00 x1875732036926208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837669.319624:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036926208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788837669.561052:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837670.391154:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837670.391257:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837670.391298:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837670.391340:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012738432 00000100:00100000:0.0:1788837670.391351:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012738432 00000100:00100000:0.0:1788837670.391408:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012738304 00000100:00100000:0.0:1788837670.391412:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012738304 00000100:00100000:0.0:1788837670.391438:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 108 00000100:00100000:0.0:1788837670.391449:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012738432:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837670.391523:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012738432:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 77us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837670.391532:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 108 00000100:00100000:0.0:1788837670.391551:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 109 00000100:00100000:0.0:1788837670.391558:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:2396:x1875732012738304:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837670.391586:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:2396:x1875732012738304:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 28us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837670.391592:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 109 00000100:00080000:0.0:1788837670.391620:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837670.391625:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837670.391936:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012738176 00000100:00100000:3.0:1788837670.391942:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012738176 00000100:00100000:3.0:1788837670.391979:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 284 00000100:00100000:3.0:1788837670.391987:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2396:x1875732012738176:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837670.392041:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2396:x1875732012738176:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 55us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837670.392048:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 284 00010000:00010000:0.0:1788837670.585825:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837670.841044:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036926848:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.841118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837670.841175:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036927360:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.841201:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837670.841226:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036927872:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.841247:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837670.841276:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788837670.841282:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036926464:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.841310:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837670.841332:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036926976:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.841355:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837670.841375:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036927488:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.841394:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837670.841425:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036928000:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.841459:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837670.841489:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036926592:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.841521:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837670.841541:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036927104:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.841560:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837670.841577:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036927616:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.841597:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837670.841614:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788837670.841621:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036926720:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.841699:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837670.841718:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036927232:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.841742:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837670.841752:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036927744:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.841770:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837670.841830:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036926848 00000100:00100000:1.0:1788837670.841838:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036926848 00000100:00100000:1.0:1788837670.841874:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036926592 00000100:00100000:1.0:1788837670.841877:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036926592 00000100:00100000:1.0:1788837670.841887:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036927104 00000100:00100000:1.0:1788837670.841889:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036927104 00000100:00100000:1.0:1788837670.841914:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036927616 00000100:00100000:1.0:1788837670.841917:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036927616 00000100:00100000:1.0:1788837670.841927:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036927232 00000100:00100000:1.0:1788837670.841929:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036927232 00000100:00100000:1.0:1788837670.841940:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036927744 00000100:00100000:1.0:1788837670.841942:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036927744 00000100:00100000:1.0:1788837670.841955:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788837670.841969:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036926848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.842017:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036926848:12345-0@lo:400:kworker.0 Request processed in 50us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837670.842024:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788837670.842041:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788837670.842046:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036926592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.842072:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036926592:12345-0@lo:400:kworker.0 Request processed in 26us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837670.842078:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788837670.842089:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788837670.842094:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036927104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.842119:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036927104:12345-0@lo:400:kworker.0 Request processed in 25us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837670.842125:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788837670.842135:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788837670.842141:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036927616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.842166:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036927616:12345-0@lo:400:kworker.0 Request processed in 26us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837670.842171:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788837670.842182:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788837670.842187:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036927232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.842213:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036927232:12345-0@lo:400:kworker.0 Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837670.842219:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788837670.842230:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788837670.842243:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036927744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.842271:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036927744:12345-0@lo:400:kworker.0 Request processed in 29us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837670.842277:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788837670.842297:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036927360 00000100:00100000:1.0:1788837670.842301:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036927360 00000100:00100000:1.0:1788837670.842317:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036927872 00000100:00100000:1.0:1788837670.842320:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036927872 00000100:00100000:1.0:1788837670.842331:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036927488 00000100:00100000:1.0:1788837670.842333:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036927488 00000100:00100000:1.0:1788837670.842341:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036928000 00000100:00100000:1.0:1788837670.842343:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036928000 00000100:00100000:1.0:1788837670.842354:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788837670.842360:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036927360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.842391:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036927360:12345-0@lo:400:kworker.0 Request processed in 31us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837670.842397:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788837670.842408:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788837670.842413:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036927872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.842439:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036927872:12345-0@lo:400:kworker.0 Request processed in 26us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837670.842444:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788837670.842454:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788837670.842460:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036927488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.842484:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036927488:12345-0@lo:400:kworker.0 Request processed in 25us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837670.842489:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788837670.842508:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788837670.842513:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036928000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.842541:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036928000:12345-0@lo:400:kworker.0 Request processed in 28us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837670.842546:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788837670.842570:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036926464 00000100:00100000:1.0:1788837670.842573:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036926464 00000100:00100000:1.0:1788837670.842598:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788837670.842605:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036926464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.842636:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036926464:12345-0@lo:400:kworker.0 Request processed in 32us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837670.842668:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788837670.842698:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036926976 00000100:00100000:1.0:1788837670.842702:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036926976 00000100:00100000:1.0:1788837670.842724:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036926720 00000100:00100000:1.0:1788837670.842727:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036926720 00000100:00100000:1.0:1788837670.842740:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788837670.842746:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036926976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.842804:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036926976:12345-0@lo:400:kworker.0 Request processed in 58us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837670.842811:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788837670.842823:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788837670.842828:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036926720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.842871:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036926720:12345-0@lo:400:kworker.0 Request processed in 43us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837670.842878:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788837670.842919:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837670.842931:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837670.842933:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837670.842965:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036926720:0@lo:400:kworker.0 00010000:00080000:1.0:1788837670.842981:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c31b6680 x1875732036927232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837670.842991:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036927232:0@lo:400:kworker.0 00010000:00080000:1.0:1788837670.843001:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c43b80 x1875732036927744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837670.843010:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036927744:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.843020:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036926592:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.843029:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036927104:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.843037:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036927616:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.843083:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036926464:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.843093:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036926976:0@lo:400:kworker.0 00010000:00080000:1.0:1788837670.843102:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c31b6d80 x1875732036927488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837670.843111:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036927488:0@lo:400:kworker.0 00010000:00080000:1.0:1788837670.843120:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c40700 x1875732036928000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837670.843128:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036928000:0@lo:400:kworker.0 00000100:00100000:1.0:1788837670.843139:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036926848:0@lo:400:kworker.0 00010000:00080000:1.0:1788837670.843160:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c31b7100 x1875732036927360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837670.843168:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036927360:0@lo:400:kworker.0 00010000:00080000:1.0:1788837670.843178:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c41c00 x1875732036927872/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837670.843187:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036927872:0@lo:400:kworker.0 00000100:00100000:3.0:1788837670.845833:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837670.845857:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036928128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837670.845995:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837670.846042:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036928128 00000100:00100000:3.0:1788837670.846049:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036928128 00000100:00100000:3.0:1788837670.846092:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788837670.846101:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036928128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788837670.846129:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837670.846175:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036928128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837670.846183:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788837670.846225:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3346a00 x1875732036928128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837670.846244:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036928128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837670.847141:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837670.847154:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036928256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837670.847199:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837670.847235:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036928256 00000100:00100000:2.0:1788837670.847240:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036928256 00000100:00100000:2.0:1788837670.847273:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788837670.847281:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036928256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788837670.847307:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788837670.847345:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036928256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837670.847351:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788837670.847383:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036928256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837670.850339:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c379ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036928384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837670.850407:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837670.854411:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036928384 00000100:00100000:0.0:1788837670.854431:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036928384 00000100:00100000:0.0:1788837670.854507:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788837670.854527:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036928384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837670.854556:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837670.865262:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036928384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10733us (14841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837670.865277:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788837670.865807:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c379ed80 x1875732036928384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837670.865832:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c379ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036928384:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788837671.608967:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837671.867736:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837671.867798:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036928512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837671.867877:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837671.867897:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036928512 00000100:00100000:0.0:1788837671.867905:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036928512 00000100:00100000:0.0:1788837671.867954:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788837671.867964:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036928512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837671.868001:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788837671.868055:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036928512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837671.868062:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788837671.869155:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036928512:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788837672.633285:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837673.657975:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837674.427206:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837674.427232:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036928640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837674.427307:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837674.427341:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036928640 00000100:00100000:2.0:1788837674.427350:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036928640 00000100:00100000:1.0:1788837674.427377:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036928768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837674.427401:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837674.427411:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036928768 00000100:00100000:2.0:1788837674.427416:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036928768 00000100:00100000:2.0:1788837674.427441:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788837674.427450:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036928640:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788837674.427470:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788837674.427496:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837674.427560:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036928640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837674.427567:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788837674.427584:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788837674.427591:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036928768:12345-0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788837674.427662:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c337c000 x1875732036928640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837674.427689:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036928640:0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837674.427834:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837674.427897:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036928768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 306us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837674.427904:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788837674.427976:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c1d880 x1875732036928768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837674.427988:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036928768:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788837674.681588:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837675.506868:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837675.506902:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837675.506927:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837675.506955:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012738816 00000100:00100000:1.0:1788837675.506966:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012738816 00000100:00100000:1.0:1788837675.507021:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012738688 00000100:00100000:1.0:1788837675.507025:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012738688 00000100:00100000:1.0:1788837675.507064:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 116 00000100:00100000:1.0:1788837675.507074:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012738816:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837675.507157:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012738816:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 84us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837675.507165:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 116 00000100:00100000:1.0:1788837675.507196:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 117 00000100:00100000:1.0:1788837675.507204:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:2394:x1875732012738688:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837675.507228:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:2394:x1875732012738688:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 26us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837675.507234:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 117 00000100:00080000:1.0:1788837675.507254:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837675.507259:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837675.508201:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012738560 00000100:00100000:3.0:1788837675.508210:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012738560 00000100:00100000:3.0:1788837675.508260:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 286 00000100:00100000:3.0:1788837675.508268:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2394:x1875732012738560:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837675.508312:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2394:x1875732012738560:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 44us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837675.508319:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 286 00010000:00010000:3.0:1788837675.705189:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837675.969963:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036928896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837675.970048:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837675.970465:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036928896 00000100:00100000:0.0:1788837675.970473:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036928896 00000100:00100000:0.0:1788837675.970542:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788837675.970552:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036928896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837675.970594:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837675.970648:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036928896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837675.970655:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1788837675.970699:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c1f800 x1875732036928896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837675.970716:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036928896:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788837675.970899:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837675.970915:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036929024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837675.970949:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837675.971527:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036929408:0@lo:400:kworker.0 00000100:00100000:0.0:1788837675.971557:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837675.971602:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036929024 00000100:00100000:0.0:1788837675.971618:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036929024 00000100:00100000:0.0:1788837675.971650:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036929408 00000100:00100000:0.0:1788837675.971653:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036929408 00000100:00100000:0.0:1788837675.971671:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788837675.971677:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036929024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837675.971703:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788837675.971736:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788837675.971739:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036929024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837675.971744:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036929408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837675.971746:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788837675.971808:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036929408:12345-0@lo:400:kworker.0 Request processed in 65us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837675.971809:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036929024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837675.971815:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788837675.971839:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036929408:0@lo:400:kworker.0 00000100:00100000:0.0:1788837675.971842:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036929536:0@lo:400:kworker.0 00000100:00100000:0.0:1788837675.972107:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837675.972200:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837675.972208:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036929920:0@lo:400:kworker.0 00000100:00100000:0.0:1788837675.972236:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837675.972273:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036930048:0@lo:400:kworker.0 00000100:00100000:0.0:1788837675.972295:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837675.972350:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837675.972356:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036930432:0@lo:400:kworker.0 00000100:00100000:0.0:1788837675.972378:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837675.972413:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036929536 00000100:00100000:2.0:1788837675.972417:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036929536 00000100:00100000:2.0:1788837675.972446:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788837675.972452:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036929536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837675.972489:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036929536:12345-0@lo:400:kworker.0 Request processed in 37us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837675.972495:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788837675.972523:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036929536:0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.972623:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036929152:0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.972659:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837675.972692:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036929664:0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.972714:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837675.972740:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036930176:0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.972758:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837675.972800:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788837675.972805:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036929280:0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.972825:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837675.972838:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036929792:0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.973046:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837675.973063:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036930304:0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.973099:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837675.973127:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036929920 00000100:00100000:1.0:1788837675.973131:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036929920 00000100:00100000:1.0:1788837675.973161:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036930048 00000100:00100000:1.0:1788837675.973164:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036930048 00000100:00100000:1.0:1788837675.973176:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036930432 00000100:00100000:1.0:1788837675.973178:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036930432 00000100:00100000:1.0:1788837675.973203:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788837675.973210:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036929920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.973250:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036929920:12345-0@lo:400:kworker.0 Request processed in 40us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837675.973257:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788837675.973272:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788837675.973278:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036930048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.973304:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036930048:12345-0@lo:400:kworker.0 Request processed in 27us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837675.973309:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788837675.973320:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788837675.973326:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036930432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.973351:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036930432:12345-0@lo:400:kworker.0 Request processed in 26us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837675.973357:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788837675.973380:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036929664 00000100:00100000:1.0:1788837675.973384:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036929664 00000100:00100000:1.0:1788837675.973400:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036930176 00000100:00100000:1.0:1788837675.973403:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036930176 00000100:00100000:1.0:1788837675.973413:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036929280 00000100:00100000:1.0:1788837675.973415:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036929280 00000100:00100000:1.0:1788837675.973436:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036929792 00000100:00100000:1.0:1788837675.973440:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036929792 00000100:00100000:1.0:1788837675.973453:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036930304 00000100:00100000:1.0:1788837675.973456:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036930304 00000100:00100000:1.0:1788837675.973469:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788837675.973475:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036929664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.973509:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036929664:12345-0@lo:400:kworker.0 Request processed in 34us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837675.973515:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788837675.973526:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788837675.973532:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036930176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.973558:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036930176:12345-0@lo:400:kworker.0 Request processed in 27us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837675.973564:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788837675.973587:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788837675.973592:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036929280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.973620:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036929280:12345-0@lo:400:kworker.0 Request processed in 28us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837675.973626:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788837675.973636:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788837675.973642:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036929792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.973668:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036929792:12345-0@lo:400:kworker.0 Request processed in 27us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837675.973673:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788837675.973684:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788837675.973690:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036930304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.973727:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036930304:12345-0@lo:400:kworker.0 Request processed in 38us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837675.973733:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788837675.973762:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036929152 00000100:00100000:2.0:1788837675.973767:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036929152 00000100:00100000:2.0:1788837675.973813:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788837675.973820:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3650:x1875732036929152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837675.973854:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3650:x1875732036929152:12345-0@lo:400:kworker.0 Request processed in 35us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837675.973867:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788837675.974669:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036929280:0@lo:400:kworker.0 00010000:00080000:1.0:1788837675.974691:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c1aa00 x1875732036929792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837675.974702:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036929792:0@lo:400:kworker.0 00010000:00080000:1.0:1788837675.974714:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c18000 x1875732036930304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837675.974722:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036930304:0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.974731:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036929152:0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.974741:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036929664:0@lo:400:kworker.0 00000100:00100000:1.0:1788837675.974750:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036930176:0@lo:400:kworker.0 00000100:00100000:2.0:1788837675.974802:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837675.974818:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036930560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837675.974862:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837675.974909:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036930560 00000100:00100000:0.0:1788837675.974914:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036930560 00000100:00100000:0.0:1788837675.974952:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788837675.974961:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036930560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788837675.974977:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837675.975025:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036930560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837675.975040:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788837675.975094:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3344700 x1875732036930560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837675.975107:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036930560:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788837675.976302:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837675.976314:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837675.976318:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788837675.976354:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c19180 x1875732036930432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837675.976368:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036930432:0@lo:400:kworker.0 00010000:00080000:1.0:1788837675.976381:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c1bb80 x1875732036930048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837675.976389:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036930048:0@lo:400:kworker.0 00010000:00080000:1.0:1788837675.976421:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c19500 x1875732036929920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837675.976430:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036929920:0@lo:400:kworker.0 00000001:02000400:3.0:1788837676.211225:0:12001:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:21:15 (1788837675) === 00000100:00100000:0.0:1788837676.523484:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837676.524368:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012738944 00000100:00100000:1.0:1788837676.524379:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012738944 00000100:00100000:1.0:1788837676.524444:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 288 00000100:00100000:1.0:1788837676.524455:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:8706:x1875732012738944:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788837676.524472:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837676.524491:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c8400/0x57f6d4e926aef09f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003e94f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837676.524522:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c8400/0x57f6d4e926aef09f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e94f expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837676.524535:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c8400/0x57f6d4e926aef09f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e94f expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837676.524556:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8400, rc 0) 00000100:00100000:1.0:1788837676.524619:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:8706:x1875732012738944:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 166us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837676.524626:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 288 00000100:00100000:1.0:1788837676.544435:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837676.544516:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012739072 00000100:00100000:2.0:1788837676.544527:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012739072 00000100:00100000:2.0:1788837676.544603:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 289 00000100:00100000:2.0:1788837676.544614:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:8706:x1875732012739072:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788837676.544818:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:8706:x1875732012739072:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 205us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837676.544826:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 289 00000100:00100000:0.0:1788837676.549212:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837676.551944:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012739200 00000100:00100000:2.0:1788837676.551962:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012739200 00000100:00100000:2.0:1788837676.552040:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 290 00000100:00100000:2.0:1788837676.552051:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:8706:x1875732012739200:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788837676.552215:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:8706:x1875732012739200:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 164us (3024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837676.552224:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 290 00000100:00100000:3.0:1788837676.556083:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837676.559727:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012739328 00000100:00100000:1.0:1788837676.559742:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012739328 00000100:00100000:3.0:1788837676.559910:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 291 00000100:00100000:3.0:1788837676.559923:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:8710:x1875732012739328:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837676.560112:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:8710:x1875732012739328:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 192us (4040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837676.560121:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 291 00000100:00100000:1.0:1788837676.584416:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837676.586830:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012739456 00000100:00100000:2.0:1788837676.586846:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012739456 00000100:00100000:2.0:1788837676.586919:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 292 00000100:00100000:2.0:1788837676.586930:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:8710:x1875732012739456:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788837676.587135:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:8710:x1875732012739456:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 206us (2729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837676.587144:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 292 00000100:00100000:2.0:1788837676.595634:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837676.596110:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012739584 00000100:00100000:0.0:1788837676.596120:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012739584 00000100:00100000:0.0:1788837676.596183:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 293 00000100:00100000:0.0:1788837676.596192:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:8710:x1875732012739584:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788837676.596366:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:8710:x1875732012739584:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 174us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837676.596375:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 293 00000100:00100000:0.0:1788837676.610247:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837676.610367:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012739712 00000100:00100000:3.0:1788837676.610378:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012739712 00000100:00100000:3.0:1788837676.610435:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 294 00000100:00100000:3.0:1788837676.610444:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:8706:x1875732012739712:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788837676.610461:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837676.610489:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b16000/0x57f6d4e926aef0a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003e980 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837676.610517:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b16000/0x57f6d4e926aef0a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e980 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837676.610528:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b16000/0x57f6d4e926aef0a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e980 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837676.610537:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16000, rc 0) 00000100:00100000:3.0:1788837676.610606:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:8706:x1875732012739712:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 163us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837676.610613:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 294 00000100:00100000:1.0:1788837676.613712:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837676.614165:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012739840 00000100:00100000:2.0:1788837676.614177:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012739840 00000100:00100000:2.0:1788837676.614245:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 295 00000100:00100000:2.0:1788837676.614255:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:8706:x1875732012739840:12345-192.168.201.3@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788837676.614281:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788837676.614305:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788837676.614309:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788837676.614312:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788837676.614315:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788837676.614318:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788837676.617270:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:8706:x1875732012739840:12345-192.168.201.3@tcp:256:mount.lustre.0 Request processed in 3005us (3555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837676.617286:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 295 00000100:00100000:0.0:1788837676.620960:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837676.621071:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012739968 00000100:00100000:1.0:1788837676.621093:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012739968 00000100:00100000:1.0:1788837676.621148:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 296 00000100:00100000:1.0:1788837676.621157:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:8706:x1875732012739968:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788837676.621173:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837676.621190:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c9000/0x57f6d4e926aef0ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003e987 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837676.621229:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c9000/0x57f6d4e926aef0ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e987 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837676.621240:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c9000/0x57f6d4e926aef0ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e987 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837676.621248:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9000, rc 0) 00000100:00100000:1.0:1788837676.621304:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:8706:x1875732012739968:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 147us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837676.621310:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 296 00000100:00100000:1.0:1788837676.623426:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837676.623502:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012740096 00000100:00100000:3.0:1788837676.623509:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012740096 00000100:00100000:3.0:1788837676.623551:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 297 00000100:00100000:3.0:1788837676.623569:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:8706:x1875732012740096:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788837676.623705:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:8706:x1875732012740096:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 146us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837676.623713:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 297 00000100:00100000:2.0:1788837676.625245:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837676.625352:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012740224 00000100:00100000:3.0:1788837676.625361:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012740224 00000100:00100000:3.0:1788837676.625415:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 298 00000100:00100000:3.0:1788837676.625424:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:8706:x1875732012740224:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788837676.625589:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:8706:x1875732012740224:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 166us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837676.625597:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 298 00000100:00100000:0.0:1788837676.629011:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837676.629551:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012740352 00000100:00100000:1.0:1788837676.629572:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012740352 00000100:00100000:1.0:1788837676.629639:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 299 00000100:00100000:1.0:1788837676.629650:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:8715:x1875732012740352:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788837676.629851:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:8715:x1875732012740352:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 203us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837676.629860:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 299 00000100:00100000:1.0:1788837676.632878:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837676.636045:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012740480 00000100:00100000:2.0:1788837676.636063:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012740480 00000100:00100000:2.0:1788837676.636145:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 300 00000100:00100000:2.0:1788837676.636156:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:8715:x1875732012740480:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788837676.636579:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:8715:x1875732012740480:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 424us (3710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837676.636587:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 300 00000100:00100000:2.0:1788837676.641001:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837676.641039:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837676.641069:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837676.641088:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837676.641175:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012741248 00000100:00100000:3.0:1788837676.641185:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012741248 00000100:00100000:3.0:1788837676.641243:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012741376 00000100:00100000:3.0:1788837676.641246:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012741376 00000100:00100000:3.0:1788837676.641258:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012740608 00000100:00100000:3.0:1788837676.641260:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012740608 00000100:00100000:3.0:1788837676.641269:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012740864 00000100:00100000:3.0:1788837676.641271:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012740864 00000100:00100000:3.0:1788837676.641283:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 124 00000100:00100000:3.0:1788837676.641292:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012741248:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837676.641375:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012741248:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 84us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837676.641382:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 124 00000100:00100000:3.0:1788837676.641400:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 125 00000100:00100000:3.0:1788837676.641407:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012741376:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837676.641433:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012741376:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837676.641440:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 125 00000100:00100000:3.0:1788837676.641453:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788837676.641457:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875732012740608:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788837676.641481:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e2b39e4b-b1a1-4fb5-8aed-db8a043c6108@192.168.201.3@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:3.0:1788837676.641517:0:6524:0:(genops.c:1385:class_connect()) connect: client e2b39e4b-b1a1-4fb5-8aed-db8a043c6108, cookie 0x57f6d4e926aef0b4 00000004:00100000:3.0:1788837676.641550:0:6524:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788837676.641985:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:1.0:1788837676.642000:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1875732012740864:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788837676.642018:0:6526:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from e2b39e4b-b1a1-4fb5-8aed-db8a043c6108@192.168.201.3@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:1.0:1788837676.642047:0:6526:0:(genops.c:1385:class_connect()) connect: client e2b39e4b-b1a1-4fb5-8aed-db8a043c6108, cookie 0x57f6d4e926aef0bb 00000004:00100000:1.0:1788837676.642067:0:6526:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788837676.642238:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8899c2478000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837676.642278:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:2392:x1875732012740864:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 277us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837676.642286:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00080000:3.0:1788837676.642552:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8899c3642000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837676.642591:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:2392:x1875732012740608:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 1131us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837676.642598:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:0.0:1788837676.646234:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837676.646316:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837676.652605:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837676.652690:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012740992 00000100:00100000:1.0:1788837676.652701:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012740992 00000100:00100000:3.0:1788837676.652732:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012740736 00000100:00100000:3.0:1788837676.652739:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012740736 00000100:00080000:2.0:1788837676.652796:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837676.652801:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837676.653462:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:1.0:1788837676.653474:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:0:x1875732012740992:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788837676.653513:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788837676.653609:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:0:x1875732012740992:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 138us (7386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837676.653615:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:1.0:1788837676.661394:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012741120 00000100:00100000:1.0:1788837676.661414:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012741120 00000100:00100000:1.0:1788837676.661471:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:1.0:1788837676.661481:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+7:0:x1875732012740736:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788837676.661521:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788837676.662408:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:3.0:1788837676.662421:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+7:8706:x1875732012741120:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788837676.662444:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788837676.662465:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+7:0:x1875732012740736:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 984us (16147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837676.662473:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:3.0:1788837676.662482:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+7:8706:x1875732012741120:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 64us (9889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837676.662491:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:0.0:1788837676.664849:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837676.664943:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012741504 00000100:00100000:1.0:1788837676.664967:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012741504 00000100:00100000:1.0:1788837676.665180:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:1.0:1788837676.665192:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:8706:x1875732012741504:12345-192.168.201.3@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788837676.665427:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:8706:x1875732012741504:12345-192.168.201.3@tcp:40:mount.lustre.0 Request processed in 237us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837676.665435:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:0.0:1788837676.669498:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837676.669612:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012741632 00000100:00100000:1.0:1788837676.669623:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012741632 00000100:00100000:1.0:1788837676.669677:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:1.0:1788837676.669685:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1875732012741632:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788837676.669746:0:8440:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e2b39e4b-b1a1-4fb5-8aed-db8a043c6108@192.168.201.3@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:1.0:1788837676.669816:0:8440:0:(genops.c:1385:class_connect()) connect: client e2b39e4b-b1a1-4fb5-8aed-db8a043c6108, cookie 0x57f6d4e926aef0c2 00002000:00100000:1.0:1788837676.669831:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e2b39e4b-b1a1-4fb5-8aed-db8a043c6108/ffff8899c3240800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788837676.669851:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788837676.669930:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788837676.669960:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8899c3245000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837676.670034:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:2392:x1875732012741632:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 348us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837676.670042:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:3.0:1788837676.670109:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837676.670225:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012741760 00000100:00100000:1.0:1788837676.670229:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012741760 00000100:00100000:1.0:1788837676.670289:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:1.0:1788837676.670295:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875732012741760:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788837676.670313:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e2b39e4b-b1a1-4fb5-8aed-db8a043c6108@192.168.201.3@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:1.0:1788837676.670332:0:8439:0:(genops.c:1385:class_connect()) connect: client e2b39e4b-b1a1-4fb5-8aed-db8a043c6108, cookie 0x57f6d4e926aef0c9 00002000:00100000:1.0:1788837676.670346:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e2b39e4b-b1a1-4fb5-8aed-db8a043c6108/ffff889af8dbc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788837676.670353:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788837676.670397:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788837676.670413:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8899c321a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837676.670448:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:2392:x1875732012741760:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 151us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837676.670455:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:3.0:1788837676.675451:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837676.676079:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012741888 00000100:00100000:2.0:1788837676.676090:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012741888 00000100:00100000:2.0:1788837676.676210:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:2.0:1788837676.676221:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:8706:x1875732012741888:12345-192.168.201.3@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788837676.676311:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:8706:x1875732012741888:12345-192.168.201.3@tcp:900:mount.lustre.0 Request processed in 92us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837676.676320:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:3.0:1788837676.680344:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837676.680409:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012742016 00000100:00100000:1.0:1788837676.680420:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012742016 00000100:00100000:1.0:1788837676.680537:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:1.0:1788837676.680548:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:8706:x1875732012742016:12345-192.168.201.3@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788837676.680679:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788837676.680769:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:8706:x1875732012742016:12345-192.168.201.3@tcp:33:mount.lustre.0 Request processed in 222us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837676.680921:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00010000:00010000:0.0:1788837676.731320:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837676.985245:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837676.985268:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036930688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837676.985341:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837676.985751:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036930688 00000100:00100000:0.0:1788837676.985761:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036930688 00000100:00100000:0.0:1788837676.985843:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788837676.985854:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036930688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837676.985884:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788837676.985948:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036930688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837676.985972:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788837676.986166:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036930688:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788837677.752951:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837678.782030:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837679.547167:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837679.547199:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c379f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036930816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837679.547265:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837679.547338:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036930816 00000100:00100000:1.0:1788837679.547347:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036930816 00000100:00100000:1.0:1788837679.547409:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788837679.547418:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036930816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788837679.547448:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837679.547490:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036930816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837679.547525:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788837679.547548:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837679.547580:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c379f480 x1875732036930816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837679.547596:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c379f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036930816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837679.548343:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837679.548364:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036930944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837679.548400:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837679.548575:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036930944 00000100:00100000:2.0:1788837679.548581:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036930944 00000100:00100000:2.0:1788837679.548628:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788837679.548637:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036930944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837679.548651:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837679.548688:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036930944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837679.548695:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788837679.548802:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837679.548825:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c35d5880 x1875732036930944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837679.548839:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036930944:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788837679.805035:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837680.827165:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837681.081011:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036931328:0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.081086:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036931456:0@lo:400:kworker.0 00000100:00100000:0.0:1788837681.081094:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837681.081192:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036931072:0@lo:400:kworker.0 00000100:00100000:3.0:1788837681.081204:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036931328 00000100:00100000:3.0:1788837681.081212:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036931328 00000100:00100000:3.0:1788837681.081280:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788837681.081290:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036931328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.083424:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837681.083528:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036931968:0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.083581:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837681.083608:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036932480:0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.083649:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837681.083679:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036932992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837681.083705:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837681.083745:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036931968 00000100:00100000:2.0:1788837681.083753:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036931968 00000100:00100000:2.0:1788837681.083825:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036932480 00000100:00100000:2.0:1788837681.083828:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036932480 00000100:00100000:2.0:1788837681.083849:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788837681.083857:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036931968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.083905:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036931968:12345-0@lo:400:kworker.0 Request processed in 49us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837681.083912:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788837681.083928:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788837681.083934:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036932480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.083960:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036932480:12345-0@lo:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837681.083966:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788837681.083985:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036931456 00000100:00100000:2.0:1788837681.083988:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036931456 00000100:00100000:2.0:1788837681.084014:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788837681.084020:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036931456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.084050:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036931456:12345-0@lo:400:kworker.0 Request processed in 30us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837681.084055:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788837681.084071:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036932992 00000100:00100000:2.0:1788837681.084074:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036932992 00000100:00100000:2.0:1788837681.084098:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788837681.084112:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036932992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837681.084134:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837681.084166:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036932992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837681.084173:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788837681.084188:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837681.084192:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788837681.084221:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3344000 x1875732036932992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837681.084239:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036932992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837681.084250:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036931456:0@lo:400:kworker.0 00010000:00080000:2.0:1788837681.084259:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27bc700 x1875732036931968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837681.084267:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036931968:0@lo:400:kworker.0 00010000:00080000:2.0:1788837681.084276:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6eea00 x1875732036932480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837681.084284:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036932480:0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.084361:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036931200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837681.084388:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837681.084407:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036931712:0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.084425:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837681.084440:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036932224:0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.084461:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837681.084506:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036932736:0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.084545:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837681.084578:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788837681.084585:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036931840:0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.084606:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837681.084620:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036932352:0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.084638:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837681.084652:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036932864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837681.084671:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837681.084694:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036931200 00000100:00100000:2.0:1788837681.084699:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036931200 00000100:00100000:2.0:1788837681.084719:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036931712 00000100:00100000:2.0:1788837681.084722:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036931712 00000100:00100000:2.0:1788837681.084733:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788837681.084738:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036931200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788837681.084760:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788837681.084816:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036931200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837681.084823:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788837681.084835:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788837681.084840:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036931712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.084865:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036931712:12345-0@lo:400:kworker.0 Request processed in 25us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837681.084871:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788837681.084887:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036931840 00000100:00100000:2.0:1788837681.084890:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036931840 00000100:00100000:2.0:1788837681.084909:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036932352 00000100:00100000:2.0:1788837681.084916:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036932352 00000100:00100000:2.0:1788837681.084930:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788837681.084935:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036931840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.084963:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036931840:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837681.084968:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788837681.084977:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788837681.084983:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036932352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.085004:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036932352:12345-0@lo:400:kworker.0 Request processed in 22us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837681.085010:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1788837681.085023:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837681.085032:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036932864 00000100:00100000:2.0:1788837681.085036:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036932864 00000100:00100000:2.0:1788837681.085058:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788837681.085064:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036932864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837681.085074:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837681.085099:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036932864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837681.085105:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788837681.085119:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837681.085138:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036931840:0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.085147:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036932352:0@lo:400:kworker.0 00010000:00080000:2.0:1788837681.085156:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c337c000 x1875732036932864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837681.085169:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036932864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837681.085188:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036931200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837681.085196:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036931712:0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.085236:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036932224 00000100:00100000:2.0:1788837681.085239:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036932224 00000100:00100000:2.0:1788837681.085266:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036932736 00000100:00100000:2.0:1788837681.085269:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036932736 00000100:00100000:2.0:1788837681.085283:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788837681.085289:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036932224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.085322:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036932224:12345-0@lo:400:kworker.0 Request processed in 34us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837681.085328:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788837681.085338:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788837681.085344:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036932736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.085369:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036932736:12345-0@lo:400:kworker.0 Request processed in 25us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837681.085375:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788837681.085390:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837681.085405:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6edf80 x1875732036932224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837681.085415:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036932224:0@lo:400:kworker.0 00010000:00080000:2.0:1788837681.085424:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6ed880 x1875732036932736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837681.085430:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036932736:0@lo:400:kworker.0 00000100:00100000:1.0:1788837681.095889:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837681.096373:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036931584:0@lo:400:kworker.0 00000100:00100000:1.0:1788837681.097052:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837681.097097:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036932096:0@lo:400:kworker.0 00000100:00100000:1.0:1788837681.097133:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837681.097171:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036932096 00000100:00100000:1.0:1788837681.097179:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036932096 00000100:00100000:1.0:1788837681.097329:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788837681.097338:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036932096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837681.097390:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036932096:12345-0@lo:400:kworker.0 Request processed in 53us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837681.097411:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788837681.097644:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837681.097665:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036931584 00000100:00100000:0.0:1788837681.097672:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036931584 00010000:00080000:1.0:1788837681.097673:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27bce00 x1875732036932096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837681.097690:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036932096:0@lo:400:kworker.0 00000100:00100000:1.0:1788837681.097699:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036932608:0@lo:400:kworker.0 00000100:00100000:0.0:1788837681.097717:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788837681.097729:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837681.097743:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036931584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837681.097757:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036932608 00000100:00100000:1.0:1788837681.097762:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036932608 00000100:00100000:1.0:1788837681.097812:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788837681.097817:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036931584:12345-0@lo:400:kworker.0 Request processed in 76us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837681.097825:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036932608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837681.097831:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788837681.097866:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036932608:12345-0@lo:400:kworker.0 Request processed in 45us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837681.097873:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788837681.097897:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6ee680 x1875732036932608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837681.097919:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036932608:0@lo:400:kworker.0 00000100:00100000:0.0:1788837681.097952:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036931584:0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.098169:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036931072 00000100:00100000:2.0:1788837681.098182:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036931072 00000100:00100000:2.0:1788837681.098220:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788837681.098226:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036931072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.098265:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036931072:12345-0@lo:400:kworker.0 Request processed in 39us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837681.098271:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788837681.098359:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036931072:0@lo:400:kworker.0 00000100:00100000:2.0:1788837681.102388:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036931328:12345-0@lo:400:kworker.0 Request processed in 21089us (21284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837681.102403:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788837681.102530:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036931328:0@lo:400:kworker.0 00010000:00010000:2.0:1788837681.849035:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788837682.113175:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 00000001:00100000:3.0:1788837682.115243:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 00000001:00100000:1.0:1788837682.117101:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 00000100:00100000:1.0:1788837682.117291:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036933120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837682.117362:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837682.117471:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036933120 00000100:00100000:3.0:1788837682.117479:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036933120 00000100:00100000:3.0:1788837682.117534:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788837682.117543:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036933120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837682.117591:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000001:00100000:0.0:1788837682.121570:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 00000100:00100000:3.0:1788837682.122855:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036933120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5299us (5479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837682.122872:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788837682.123198:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036933120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837682.161528:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837682.161572:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837682.161604:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837682.161634:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837682.161651:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837682.161672:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837682.161692:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837682.161736:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012742400 00000100:00100000:0.0:1788837682.161747:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012742400 00000100:00100000:0.0:1788837682.161849:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012742656 00000100:00100000:0.0:1788837682.161854:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012742656 00000100:00100000:0.0:1788837682.161868:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012742272 00000100:00100000:0.0:1788837682.161870:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012742272 00000100:00100000:0.0:1788837682.161883:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012742528 00000100:00100000:0.0:1788837682.161886:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012742528 00000100:00100000:0.0:1788837682.161903:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 132 00000100:00100000:0.0:1788837682.161911:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012742400:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837682.161981:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012742400:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 71us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837682.161989:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 132 00000100:00100000:0.0:1788837682.162017:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 133 00000100:00100000:0.0:1788837682.162024:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012742656:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837682.162047:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012742656:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837682.162054:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 133 00000100:00100000:0.0:1788837682.162072:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 134 00000100:00100000:0.0:1788837682.162080:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:2393:x1875732012742272:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837682.162113:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:2393:x1875732012742272:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 34us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837682.162122:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 134 00000100:00100000:0.0:1788837682.162132:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 135 00000100:00100000:0.0:1788837682.162140:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012742528:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837682.162172:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012742528:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 32us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837682.162191:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 135 00000100:00100000:2.0:1788837682.162298:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012742144 00000100:00100000:2.0:1788837682.162304:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012742144 00000100:00100000:2.0:1788837682.162344:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 302 00000100:00100000:2.0:1788837682.162351:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012742144:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837682.162374:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012742144:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 25us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837682.162379:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 302 00000100:00100000:1.0:1788837682.162571:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012742912 00000100:00100000:1.0:1788837682.162576:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012742912 00000100:00100000:1.0:1788837682.162613:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012742784 00000100:00100000:1.0:1788837682.162616:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012742784 00000100:00100000:1.0:1788837682.162642:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:1.0:1788837682.162648:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012742912:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837682.162672:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012742912:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 25us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837682.162684:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:1.0:1788837682.162696:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:1.0:1788837682.162701:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012742784:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837682.162721:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012742784:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 20us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837682.162726:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00080000:1.0:1788837682.162745:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837682.162749:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837682.162751:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837682.162754:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1788837682.315603:0:12194:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788837682.873082:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837683.901014:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837684.671998:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837684.672023:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036933248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837684.672093:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837684.674521:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837684.674542:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036933376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837684.674610:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837684.674652:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036933248 00000100:00100000:3.0:1788837684.674660:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036933248 00000100:00100000:2.0:1788837684.674666:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036933376 00000100:00100000:2.0:1788837684.674668:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036933376 00000100:00100000:3.0:1788837684.674717:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788837684.674726:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036933248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788837684.674760:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837684.674824:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036933248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (2730us total) trans 0 rc 0/0 00000100:00080000:0.0:1788837684.674875:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837684.679318:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3345880 x1875732036933248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837684.679347:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036933248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837684.679715:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788837684.679744:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788837684.679758:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036933376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837684.679796:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837684.679887:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036933376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (5276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837684.679893:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788837684.679903:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f5880 x1875732036933376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837684.679925:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036933376:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837684.933254:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837685.949713:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837686.207032:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036933504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837686.207109:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837686.207191:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036933504 00000100:00100000:2.0:1788837686.207198:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036933504 00000100:00100000:2.0:1788837686.207253:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788837686.207264:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036933504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837686.207291:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837686.207336:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036933504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837686.207344:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788837686.207365:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788837686.207403:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f5880 x1875732036933504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837686.207421:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036933504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837686.207833:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036933760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837686.207862:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837686.207901:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036933760 00000100:00100000:3.0:1788837686.207906:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036933760 00000100:00100000:3.0:1788837686.207996:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788837686.208013:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036933760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788837686.208025:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837686.208057:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036933760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837686.208063:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788837686.208080:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788837686.208096:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa7ae300 x1875732036933760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837686.208108:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036933760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837686.208123:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837686.208131:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036933632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837686.208156:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837686.208312:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036933888:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.208343:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837686.208366:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036934400:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.208400:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837686.208420:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732036934912:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.208442:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837686.208460:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788837686.208465:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732036934272:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.208482:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837686.208495:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036934784:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.208514:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837686.208536:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036933888 00000100:00100000:3.0:1788837686.208540:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036933888 00000100:00100000:3.0:1788837686.208576:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788837686.208583:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732036933888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.208617:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732036933888:12345-0@lo:400:kworker.0 Request processed in 35us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837686.208624:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788837686.208649:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036934400 00000100:00100000:3.0:1788837686.208653:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036934400 00000100:00100000:3.0:1788837686.208681:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036934912 00000100:00100000:3.0:1788837686.208684:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036934912 00000100:00100000:3.0:1788837686.208695:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036934272 00000100:00100000:3.0:1788837686.208697:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036934272 00000100:00100000:3.0:1788837686.208709:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788837686.208715:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036934400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.208746:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036934400:12345-0@lo:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837686.208752:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788837686.208763:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788837686.208769:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732036934912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.208820:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732036934912:12345-0@lo:400:kworker.0 Request processed in 51us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837686.208825:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788837686.208838:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788837686.208844:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732036934272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.208871:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732036934272:12345-0@lo:400:kworker.0 Request processed in 27us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837686.208877:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788837686.208900:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036934784 00000100:00100000:3.0:1788837686.208909:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036934784 00000100:00100000:3.0:1788837686.208937:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788837686.208943:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036934784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.208971:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036934784:12345-0@lo:400:kworker.0 Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837686.208977:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788837686.208998:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837686.209001:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837686.209019:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732036934272:0@lo:400:kworker.0 00010000:00080000:3.0:1788837686.209030:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac618ed80 x1875732036934784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837686.209039:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036934784:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.209047:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036933888:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.209054:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036934400:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.209062:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732036934912:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.209089:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036934016:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.209112:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837686.209131:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036934528:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.209150:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837686.209165:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036935040:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.209184:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837686.209201:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788837686.209207:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036934144:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.209237:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837686.209255:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036934656:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.209274:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837686.209300:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036933632 00000100:00100000:3.0:1788837686.209304:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036933632 00000100:00100000:3.0:1788837686.209328:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036934144 00000100:00100000:3.0:1788837686.209331:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036934144 00000100:00100000:3.0:1788837686.209346:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788837686.209351:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036933632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788837686.209376:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788837686.209426:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036933632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837686.209432:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788837686.209445:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788837686.209451:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036934144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.209477:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036934144:12345-0@lo:400:kworker.0 Request processed in 26us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837686.209483:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788837686.209498:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036934656 00000100:00100000:3.0:1788837686.209502:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036934656 00000100:00100000:3.0:1788837686.209528:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788837686.209534:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036934656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.209562:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036934656:12345-0@lo:400:kworker.0 Request processed in 29us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837686.209568:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788837686.209587:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036934016 00000100:00100000:3.0:1788837686.209590:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036934016 00000100:00100000:3.0:1788837686.209619:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036934528 00000100:00100000:3.0:1788837686.209622:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036934528 00000100:00100000:3.0:1788837686.209633:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036935040 00000100:00100000:3.0:1788837686.209635:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036935040 00000100:00100000:3.0:1788837686.209647:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788837686.209653:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036934016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.209681:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036934016:12345-0@lo:400:kworker.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837686.209688:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788837686.209698:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788837686.209704:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036934528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.209729:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036934528:12345-0@lo:400:kworker.0 Request processed in 25us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837686.209735:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788837686.209745:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788837686.209750:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036935040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.209795:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036935040:12345-0@lo:400:kworker.0 Request processed in 26us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837686.209802:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1788837686.209821:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788837686.209824:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837686.209845:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036934144:0@lo:400:kworker.0 00010000:00080000:3.0:1788837686.212997:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac618c000 x1875732036934656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837686.213022:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036934656:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.213061:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036934016:0@lo:400:kworker.0 00010000:00080000:3.0:1788837686.213092:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac618e300 x1875732036934528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837686.213101:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036934528:0@lo:400:kworker.0 00010000:00080000:3.0:1788837686.213113:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac618f480 x1875732036935040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837686.213121:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036935040:0@lo:400:kworker.0 00000100:00100000:3.0:1788837686.213142:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036933632:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788837686.970034:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837687.228474:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837687.228498:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036935168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837687.228571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837687.228686:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036935168 00000100:00100000:0.0:1788837687.228694:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036935168 00000100:00100000:0.0:1788837687.228744:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788837687.228753:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036935168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837687.228802:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788837687.228850:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036935168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837687.228858:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788837687.228901:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036935168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837687.282722:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837687.282772:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837687.282836:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837687.282867:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837687.282891:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837687.282915:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837687.282916:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012743296 00000100:00100000:2.0:1788837687.282928:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012743296 00000100:00100000:3.0:1788837687.282962:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837687.282985:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012743552 00000100:00100000:3.0:1788837687.282993:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012743808 00000100:00100000:3.0:1788837687.282999:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012743808 00000100:00100000:2.0:1788837687.283001:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012743552 00000100:00100000:2.0:1788837687.283028:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012743168 00000100:00100000:2.0:1788837687.283032:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012743168 00000100:00100000:3.0:1788837687.283040:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012743680 00000100:00100000:3.0:1788837687.283045:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012743680 00000100:00100000:2.0:1788837687.283052:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012743424 00000100:00100000:2.0:1788837687.283058:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012743424 00000100:00100000:3.0:1788837687.283078:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:2.0:1788837687.283086:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 142 00000100:00100000:3.0:1788837687.283091:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2394:x1875732012743808:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837687.283099:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012743296:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837687.283163:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2394:x1875732012743808:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 76us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837687.283179:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:0.0:1788837687.283187:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012743040 00000100:00100000:0.0:1788837687.283193:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012743040 00000100:00100000:3.0:1788837687.283201:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:3.0:1788837687.283211:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2394:x1875732012743680:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837687.283231:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 304 00000100:00100000:2.0:1788837687.283232:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012743296:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 137us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837687.283240:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 142 00000100:00100000:0.0:1788837687.283240:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2394:x1875732012743040:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837687.283253:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 143 00000100:00100000:3.0:1788837687.283259:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2394:x1875732012743680:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 49us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837687.283262:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2394:x1875732012743552:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837687.283271:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2394:x1875732012743040:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 32us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837687.283276:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:0.0:1788837687.283284:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 304 00000100:00100000:2.0:1788837687.283288:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2394:x1875732012743552:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837687.283294:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 143 00000100:00100000:3.0:1788837687.283309:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 144 00000100:00100000:3.0:1788837687.283319:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:2394:x1875732012743168:12345-192.168.201.3@tcp:400:kworker.0 00000100:00080000:0.0:1788837687.283410:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837687.283416:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837687.283419:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837687.283422:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837687.283435:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:2394:x1875732012743168:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 115us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837687.283456:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 145 00000100:00100000:2.0:1788837687.283467:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2394:x1875732012743424:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837687.283493:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2394:x1875732012743424:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 30us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837687.283500:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 145 00000100:00100000:3.0:1788837687.293875:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 144 00010000:00010000:0.0:1788837688.001224:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837689.016986:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788837689.482964:0:12510:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788837689.483556:0:12510:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788837689.785678:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036935424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837689.785752:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837689.785753:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036935296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837689.786103:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837689.786164:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036935424 00000100:00100000:0.0:1788837689.786170:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036935424 00000100:00100000:0.0:1788837689.786213:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036935296 00000100:00100000:0.0:1788837689.786217:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036935296 00000100:00100000:0.0:1788837689.786234:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788837689.786242:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036935424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837689.786282:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788837689.786601:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837689.795559:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036935424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9305us (9794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837689.795575:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1788837689.795587:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa5f3100 x1875732036935424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837689.795610:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036935424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837689.795613:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788837689.795628:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036935296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837689.795652:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837689.795727:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036935296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (9624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837689.795734:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1788837689.795809:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f5880 x1875732036935296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837689.795825:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036935296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788837690.041080:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837691.065500:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788837691.278050:0:12607:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788837691.278267:0:12607:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788837691.320906:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036935552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837691.320953:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036935808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837691.320974:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837691.320998:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036935680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837691.321025:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837691.321045:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036935552 00000100:00100000:2.0:1788837691.321052:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036935552 00000100:00100000:2.0:1788837691.321106:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788837691.321117:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036935552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837691.321144:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837691.321188:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036935552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837691.321223:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788837691.321244:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837691.321249:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837691.321284:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036935680 00000100:00100000:3.0:1788837691.321289:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036935680 00000100:00100000:3.0:1788837691.321327:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788837691.321335:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae5674850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036935680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788837691.321554:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788837691.321595:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae5674850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036935680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 261us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837691.321602:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788837691.322025:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036935680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837691.322043:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036936192:0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.322082:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837691.322102:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036936704:0@lo:400:kworker.0 00000100:00100000:1.0:1788837691.322109:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036936192 00000100:00100000:1.0:1788837691.322113:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036936192 00000100:00100000:3.0:1788837691.322125:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837691.322137:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788837691.322143:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036936192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.322149:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788837691.322154:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036936064:0@lo:400:kworker.0 00000100:00100000:1.0:1788837691.322177:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036936192:12345-0@lo:400:kworker.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837691.322183:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788837691.322248:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837691.322336:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732036936576:0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.322372:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837691.322601:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732036937088:0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.322624:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837691.322640:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036936064 00000100:00100000:1.0:1788837691.322644:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036936064 00000100:00100000:1.0:1788837691.322670:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036936576 00000100:00100000:1.0:1788837691.322673:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036936576 00000100:00100000:1.0:1788837691.322703:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788837691.322709:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036936064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837691.322742:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036936064:12345-0@lo:400:kworker.0 Request processed in 33us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837691.322749:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788837691.322762:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788837691.322768:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732036936576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837691.322814:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732036936576:12345-0@lo:400:kworker.0 Request processed in 45us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837691.322820:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1788837691.322849:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837691.323060:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036936192:0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.323080:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036936064:0@lo:400:kworker.0 00010000:00080000:3.0:1788837691.323091:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c31b7100 x1875732036936576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837691.323101:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732036936576:0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.323121:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036935936:0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.323153:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837691.323188:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036936448:0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.323224:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837691.323335:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732036936960:0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.323364:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837691.323433:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036937088 00000100:00100000:1.0:1788837691.323437:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036937088 00000100:00100000:1.0:1788837691.323462:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036936448 00000100:00100000:1.0:1788837691.323465:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036936448 00000100:00100000:1.0:1788837691.323477:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788837691.323483:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732036937088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837691.323516:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732036937088:12345-0@lo:400:kworker.0 Request processed in 33us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837691.323522:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788837691.323533:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788837691.323538:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036936448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837691.323562:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036936448:12345-0@lo:400:kworker.0 Request processed in 24us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837691.323573:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1788837691.323587:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837691.323590:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837691.323672:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036936448:0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.323681:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788837691.323688:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732036936320:0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.323709:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837691.323751:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036936832:0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.323796:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837691.323842:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036936704 00000100:00100000:3.0:1788837691.323845:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036936704 00000100:00100000:3.0:1788837691.323879:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036936832 00000100:00100000:3.0:1788837691.323882:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036936832 00000100:00100000:3.0:1788837691.323903:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788837691.323909:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036936704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.323939:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036936704:12345-0@lo:400:kworker.0 Request processed in 31us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837691.323945:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788837691.323955:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788837691.323960:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036936832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.323985:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036936832:12345-0@lo:400:kworker.0 Request processed in 26us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837691.323991:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788837691.324093:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036936960 00000100:00100000:1.0:1788837691.324097:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036936960 00000100:00100000:1.0:1788837691.324116:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036936320 00000100:00100000:1.0:1788837691.324119:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036936320 00000100:00100000:1.0:1788837691.324129:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788837691.324134:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732036936960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837691.324162:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732036936960:12345-0@lo:400:kworker.0 Request processed in 28us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837691.324168:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788837691.324249:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788837691.324256:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732036936320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837691.324284:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732036936320:12345-0@lo:400:kworker.0 Request processed in 29us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837691.324290:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788837691.324437:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036935936 00000100:00100000:3.0:1788837691.324442:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036935936 00000100:00100000:3.0:1788837691.324517:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788837691.324533:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732036935936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.324564:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732036935936:12345-0@lo:400:kworker.0 Request processed in 33us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837691.324571:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00010000:00080000:3.0:1788837691.324651:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c31b4a80 x1875732036937088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837691.324662:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732036937088:0@lo:400:kworker.0 00010000:00080000:3.0:1788837691.324673:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c31b7b80 x1875732036936704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837691.324682:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036936704:0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.324719:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732036936320:0@lo:400:kworker.0 00010000:00080000:3.0:1788837691.324730:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c31b6d80 x1875732036936832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837691.324738:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036936832:0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.324746:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036935936:0@lo:400:kworker.0 00000100:00100000:3.0:1788837691.324754:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732036936960:0@lo:400:kworker.0 00000100:00080000:3.0:1788837691.324772:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837691.324931:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837691.324967:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f6d80 x1875732036935552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837691.324983:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036935552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837691.327524:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036935808 00000100:00100000:2.0:1788837691.327539:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036935808 00000100:00080000:2.0:1788837691.327570:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837691.327613:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788837691.327624:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036935808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837691.327653:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837691.327751:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036935808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (6501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837691.327758:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1788837691.327813:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa5f1c00 x1875732036935808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837691.327832:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036935808:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788837692.089263:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837692.344971:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837692.344994:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036937216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837692.345059:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837692.345103:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036937216 00000100:00100000:3.0:1788837692.345127:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036937216 00000100:00100000:3.0:1788837692.345226:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788837692.345236:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036937216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837692.345268:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788837692.345347:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036937216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837692.345356:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788837692.345433:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036937216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837692.401998:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837692.402063:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837692.402348:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012743936 00000100:00100000:0.0:1788837692.402359:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012743936 00000100:00100000:2.0:1788837692.402381:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012744064 00000100:00100000:2.0:1788837692.402387:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012744064 00000100:00100000:0.0:1788837692.402425:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 306 00000100:00100000:0.0:1788837692.402437:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012743936:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837692.402440:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 152 00000100:00100000:2.0:1788837692.402454:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2393:x1875732012744064:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837692.402516:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012743936:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 82us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837692.402534:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 306 00000100:00080000:3.0:1788837692.402607:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837692.402690:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2393:x1875732012744064:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 240us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837692.402706:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 152 00000100:00100000:3.0:1788837692.405820:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837692.405853:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837692.405875:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837692.405895:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837692.405915:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837692.405941:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012744192 00000100:00100000:3.0:1788837692.405949:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012744192 00000100:00100000:3.0:1788837692.405993:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012744320 00000100:00100000:3.0:1788837692.405995:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012744320 00000100:00100000:3.0:1788837692.406013:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012744448 00000100:00100000:3.0:1788837692.406015:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012744448 00000100:00100000:3.0:1788837692.406032:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 153 00000100:00100000:3.0:1788837692.406041:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012744192:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837692.406106:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012744192:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 67us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837692.406115:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 153 00000100:00100000:3.0:1788837692.406129:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 154 00000100:00100000:3.0:1788837692.406136:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012744320:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837692.406165:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012744320:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 30us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837692.406171:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 154 00000100:00100000:3.0:1788837692.406180:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 155 00000100:00100000:3.0:1788837692.406185:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012744448:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837692.406202:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012744448:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 17us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837692.406208:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 155 00000100:00100000:3.0:1788837692.406224:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012744576 00000100:00100000:3.0:1788837692.406227:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012744576 00000100:00100000:3.0:1788837692.406250:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012744704 00000100:00100000:3.0:1788837692.406252:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012744704 00000100:00100000:3.0:1788837692.406270:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:3.0:1788837692.406278:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2394:x1875732012744576:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837692.406313:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2394:x1875732012744576:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 36us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837692.406319:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:3.0:1788837692.406329:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:3.0:1788837692.406335:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012744704:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837692.406352:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012744704:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 18us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837692.406358:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00080000:3.0:1788837692.406380:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837692.406383:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837692.406385:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837692.406392:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:0.0:1788837692.803263:0:12704:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788837692.806936:0:12704:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788837693.113158:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837694.137586:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788837694.494301:0:12802:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788837694.494519:0:12802:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788837694.905067:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036937344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837694.905148:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837694.905264:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036937344 00000100:00100000:2.0:1788837694.905272:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036937344 00000100:00100000:2.0:1788837694.905329:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788837694.905339:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b01d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036937344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837694.905367:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837694.905414:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b01d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036937344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837694.905421:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788837694.905831:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837694.905860:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f7800 x1875732036937344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837694.905877:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036937344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837694.907565:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036937472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837694.907633:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837694.907768:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036937472 00000100:00100000:1.0:1788837694.907893:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036937472 00000100:00100000:1.0:1788837694.907948:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788837694.907957:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036937472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788837694.907980:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837694.908022:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036937472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837694.908035:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788837694.917489:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837694.917547:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa5f3100 x1875732036937472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837694.917571:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036937472:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788837695.162808:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788837695.963631:0:12899:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788837695.964103:0:12899:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788837696.185563:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837696.441943:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036937728:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442057:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837696.442128:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036938240:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442153:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837696.442172:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036938752:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442192:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837696.442227:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788837696.442234:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036937600:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442263:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837696.442287:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036938112:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442325:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837696.442345:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036938624:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442368:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837696.442383:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036939136:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442400:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837696.442434:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732036937984:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442469:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837696.442486:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036938496:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442503:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837696.442519:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036939008:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442538:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837696.442555:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788837696.442561:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036937856:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442600:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837696.442617:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036938368:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442639:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837696.442649:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036938880:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442667:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837696.442689:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036937728 00000100:00100000:1.0:1788837696.442696:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036937728 00000100:00100000:1.0:1788837696.442734:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036938240 00000100:00100000:1.0:1788837696.442737:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036938240 00000100:00100000:1.0:1788837696.442759:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036938752 00000100:00100000:1.0:1788837696.442762:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036938752 00000100:00100000:1.0:1788837696.442772:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036937984 00000100:00100000:1.0:1788837696.442799:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036937984 00000100:00100000:1.0:1788837696.442812:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036938368 00000100:00100000:1.0:1788837696.442815:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036938368 00000100:00100000:1.0:1788837696.442826:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036938880 00000100:00100000:1.0:1788837696.442829:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036938880 00000100:00100000:1.0:1788837696.442844:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788837696.442852:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036937728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442907:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036937728:12345-0@lo:400:kworker.0 Request processed in 55us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837696.442923:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788837696.442940:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788837696.442946:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036938240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.442974:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036938240:12345-0@lo:400:kworker.0 Request processed in 29us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837696.442979:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788837696.442990:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788837696.442995:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036938752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443020:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036938752:12345-0@lo:400:kworker.0 Request processed in 25us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837696.443026:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788837696.443036:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788837696.443042:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732036937984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443073:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732036937984:12345-0@lo:400:kworker.0 Request processed in 31us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837696.443078:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788837696.443089:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788837696.443095:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036938368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443119:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036938368:12345-0@lo:400:kworker.0 Request processed in 25us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837696.443125:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788837696.443134:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788837696.443138:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036938880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443158:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036938880:12345-0@lo:400:kworker.0 Request processed in 20us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837696.443169:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788837696.443189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036937600 00000100:00100000:1.0:1788837696.443192:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036937600 00000100:00100000:1.0:1788837696.443230:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788837696.443237:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036937600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443266:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036937600:12345-0@lo:400:kworker.0 Request processed in 30us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837696.443271:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788837696.443297:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036938112 00000100:00100000:1.0:1788837696.443301:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036938112 00000100:00100000:1.0:1788837696.443332:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036937856 00000100:00100000:1.0:1788837696.443334:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036937856 00000100:00100000:1.0:1788837696.443346:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788837696.443351:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036938112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443380:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036938112:12345-0@lo:400:kworker.0 Request processed in 28us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837696.443386:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788837696.443396:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788837696.443401:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036937856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443423:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036937856:12345-0@lo:400:kworker.0 Request processed in 23us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837696.443429:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788837696.443444:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036938624 00000100:00100000:1.0:1788837696.443447:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036938624 00000100:00100000:1.0:1788837696.443463:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036939136 00000100:00100000:1.0:1788837696.443465:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036939136 00000100:00100000:1.0:1788837696.443474:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036938496 00000100:00100000:1.0:1788837696.443482:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036938496 00000100:00100000:1.0:1788837696.443494:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036939008 00000100:00100000:1.0:1788837696.443496:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036939008 00000100:00100000:1.0:1788837696.443506:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788837696.443511:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036938624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443538:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036938624:12345-0@lo:400:kworker.0 Request processed in 27us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837696.443544:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788837696.443553:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788837696.443558:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036939136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443581:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036939136:12345-0@lo:400:kworker.0 Request processed in 23us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837696.443586:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788837696.443595:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788837696.443599:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036938496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443626:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036938496:12345-0@lo:400:kworker.0 Request processed in 26us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837696.443632:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788837696.443641:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837696.443647:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036939008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443672:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036939008:12345-0@lo:400:kworker.0 Request processed in 26us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837696.443678:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1788837696.443711:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837696.443715:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837696.443718:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837696.443720:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837696.443758:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036937856:0@lo:400:kworker.0 00010000:00080000:1.0:1788837696.443773:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c35d4380 x1875732036938368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837696.443806:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036938368:0@lo:400:kworker.0 00010000:00080000:1.0:1788837696.443817:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2653480 x1875732036938880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837696.443825:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036938880:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443835:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732036937984:0@lo:400:kworker.0 00010000:00080000:1.0:1788837696.443844:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c35d6a00 x1875732036938496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837696.443852:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036938496:0@lo:400:kworker.0 00010000:00080000:1.0:1788837696.443861:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2652d80 x1875732036939008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837696.443869:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036939008:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443908:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036937600:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443917:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036938112:0@lo:400:kworker.0 00010000:00080000:1.0:1788837696.443926:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c35d5f80 x1875732036938624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837696.443933:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036938624:0@lo:400:kworker.0 00010000:00080000:1.0:1788837696.443942:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2652680 x1875732036939136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837696.443962:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036939136:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443974:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036937728:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443984:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036938240:0@lo:400:kworker.0 00000100:00100000:1.0:1788837696.443992:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036938752:0@lo:400:kworker.0 00000100:00100000:3.0:1788837696.446875:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036939264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837696.446946:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837696.447004:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036939264 00000100:00100000:3.0:1788837696.447011:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036939264 00000100:00100000:3.0:1788837696.447057:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788837696.447066:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036939264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788837696.447097:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788837696.447142:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036939264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837696.447149:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788837696.447193:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036939264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837696.448588:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837696.448604:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c25b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036939392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837696.448652:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837696.448686:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036939392 00000100:00100000:1.0:1788837696.448691:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036939392 00000100:00100000:1.0:1788837696.448725:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788837696.448734:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036939392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788837696.448756:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837696.448817:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036939392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837696.448824:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788837696.448861:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c25b4380 x1875732036939392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837696.448876:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c25b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036939392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837696.449071:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837696.449080:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036939520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837696.449109:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837696.449188:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036939520 00000100:00100000:0.0:1788837696.449192:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036939520 00000100:00100000:0.0:1788837696.449233:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788837696.449239:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036939520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837696.449249:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837696.449280:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036939520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837696.449286:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1788837696.449353:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f5500 x1875732036939520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837696.449367:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036939520:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788837697.211448:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837697.465216:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036939648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837697.465302:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837697.465476:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036939648 00000100:00100000:1.0:1788837697.465486:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036939648 00000100:00100000:1.0:1788837697.465554:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788837697.465565:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036939648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788837697.465631:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788837697.465703:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036939648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837697.465710:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788837697.465906:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036939648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837697.530634:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837697.532060:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837697.532091:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837697.533188:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012745472 00000100:00100000:3.0:1788837697.533209:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012745472 00000100:00100000:3.0:1788837697.533341:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:3.0:1788837697.533350:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2392:x1875732012745472:12345-192.168.201.3@tcp:9:kworker.0 00000020:00000080:3.0:1788837697.533378:0:8441:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aef0c2 00000100:00080000:3.0:1788837697.533386:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8899c3245000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788837697.533432:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788837697.533579:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+2:2392:x1875732012745472:12345-192.168.201.3@tcp:9:kworker.0 Request processed in 229us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837697.533598:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00080000:1.0:1788837697.535131:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788837697.535175:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837697.544883:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837697.544920:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012745600 00000100:00100000:0.0:1788837697.544931:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012745600 00000100:00100000:0.0:1788837697.544992:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:0.0:1788837697.545004:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2392:x1875732012745600:12345-192.168.201.3@tcp:9:kworker.0 00000020:00000080:0.0:1788837697.545047:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aef0c9 00000100:00080000:0.0:1788837697.545057:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8899c321a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837697.545102:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788837697.545276:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+2:2392:x1875732012745600:12345-192.168.201.3@tcp:9:kworker.0 Request processed in 273us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837697.545444:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00080000:0.0:1788837697.545469:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788837697.545491:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837697.545525:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837697.545643:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837697.546877:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012744960 00000100:00100000:2.0:1788837697.546887:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012744960 00000100:00100000:2.0:1788837697.546937:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012745216 00000100:00100000:2.0:1788837697.546941:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012745216 00000100:00100000:2.0:1788837697.546965:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 162 00000100:00100000:2.0:1788837697.546973:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:2396:x1875732012744960:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837697.547056:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:2396:x1875732012744960:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 83us (16442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837697.547064:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 162 00000100:00100000:2.0:1788837697.547081:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 163 00000100:00100000:2.0:1788837697.547088:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012745216:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837697.547110:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012745216:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (15018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837697.547116:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 163 00000100:00080000:2.0:1788837697.547134:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837697.551135:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012744832 00000100:00100000:1.0:1788837697.551150:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012744832 00000100:00100000:1.0:1788837697.551233:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 308 00000100:00100000:1.0:1788837697.551244:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012744832:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837697.552368:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012744832:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 1121us (6838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837697.552378:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 308 00000100:00100000:0.0:1788837697.552586:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837697.552613:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012745088 00000100:00100000:0.0:1788837697.552619:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012745088 00000100:00100000:1.0:1788837697.552798:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012745344 00000100:00100000:1.0:1788837697.552802:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012745344 00000100:00100000:1.0:1788837697.552844:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 164 00000100:00100000:1.0:1788837697.552853:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012745344:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837697.552898:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012745344:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837697.552905:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 164 00000100:00080000:1.0:1788837697.552921:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788837697.553465:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 165 00000100:00100000:0.0:1788837697.553477:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012745088:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837697.553514:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012745088:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 40us (7871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837697.553521:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 165 00000100:00080000:1.0:1788837697.554904:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788837698.235068:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837699.259306:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788837699.895967:0:13043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788837700.026816:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837700.026839:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036939776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837700.026929:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837700.026998:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036939776 00000100:00100000:2.0:1788837700.027005:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036939776 00000100:00100000:2.0:1788837700.027060:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788837700.027069:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036939776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837700.027098:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837700.027142:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036939776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837700.027149:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1788837700.027201:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f6680 x1875732036939776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837700.027219:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036939776:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788837700.028204:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837700.028318:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837700.028332:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036939904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837700.028384:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837700.028508:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036939904 00000100:00100000:2.0:1788837700.028518:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036939904 00000100:00100000:2.0:1788837700.028564:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788837700.028572:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036939904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837700.028599:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837700.028635:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036939904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837700.028642:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1788837700.028766:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837700.028834:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f6680 x1875732036939904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837700.028848:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036939904:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788837700.281125:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837701.311038:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837701.566987:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036940032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837701.567057:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837701.567139:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036940032 00000100:00100000:0.0:1788837701.567146:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036940032 00000100:00100000:0.0:1788837701.567188:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788837701.567195:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036940032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837701.567225:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788837701.567263:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036940032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837701.567270:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788837701.567376:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036940032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837701.567611:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036940160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837701.567639:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837701.567656:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036940672:0@lo:400:kworker.0 00000100:00100000:2.0:1788837701.567676:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837701.567689:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036941184:0@lo:400:kworker.0 00000100:00100000:2.0:1788837701.567719:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837701.567736:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036941696:0@lo:400:kworker.0 00000100:00100000:2.0:1788837701.567752:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837701.567767:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788837701.567771:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036940288:0@lo:400:kworker.0 00000100:00100000:2.0:1788837701.567821:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837701.567840:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036940800:0@lo:400:kworker.0 00000100:00100000:2.0:1788837701.567858:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837701.567870:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036941312:0@lo:400:kworker.0 00000100:00100000:2.0:1788837701.567884:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837701.567908:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036940160 00000100:00100000:2.0:1788837701.567911:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036940160 00000100:00100000:2.0:1788837701.567945:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788837701.567951:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036940160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837701.567979:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837701.568008:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036940160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837701.568015:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788837701.568031:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036940672 00000100:00100000:2.0:1788837701.568034:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036940672 00000100:00100000:2.0:1788837701.568054:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036940800 00000100:00100000:2.0:1788837701.568056:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036940800 00000100:00100000:2.0:1788837701.568067:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036941312 00000100:00100000:2.0:1788837701.568069:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036941312 00000100:00100000:2.0:1788837701.568081:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788837701.568086:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036940672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837701.568114:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036940672:12345-0@lo:400:kworker.0 Request processed in 28us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837701.568120:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788837701.568143:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788837701.568149:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036940800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837701.568171:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036940800:12345-0@lo:400:kworker.0 Request processed in 23us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837701.568176:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788837701.568184:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788837701.568189:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036941312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837701.568207:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036941312:12345-0@lo:400:kworker.0 Request processed in 18us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837701.568212:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788837701.568226:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036941184 00000100:00100000:2.0:1788837701.568229:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036941184 00000100:00100000:2.0:1788837701.568251:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036941696 00000100:00100000:2.0:1788837701.568253:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036941696 00000100:00100000:2.0:1788837701.568266:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788837701.568271:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036941184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837701.568297:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036941184:12345-0@lo:400:kworker.0 Request processed in 26us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837701.568303:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788837701.568311:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788837701.568316:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036941696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837701.568334:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036941696:12345-0@lo:400:kworker.0 Request processed in 19us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837701.568339:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788837701.568355:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036940288 00000100:00100000:2.0:1788837701.568358:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036940288 00000100:00100000:2.0:1788837701.568377:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788837701.568383:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036940288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837701.568405:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036940288:12345-0@lo:400:kworker.0 Request processed in 23us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837701.568411:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:2.0:1788837701.568430:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837701.568434:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837701.568468:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036940288:0@lo:400:kworker.0 00000100:00100000:2.0:1788837701.568478:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036940800:0@lo:400:kworker.0 00000100:00100000:2.0:1788837701.568485:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036941312:0@lo:400:kworker.0 00010000:00080000:2.0:1788837701.568495:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f7100 x1875732036940160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837701.568518:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036940160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837701.568528:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036940672:0@lo:400:kworker.0 00010000:00080000:2.0:1788837701.568536:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f7800 x1875732036941184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837701.568544:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036941184:0@lo:400:kworker.0 00010000:00080000:2.0:1788837701.568551:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac85e9880 x1875732036941696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837701.568559:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036941696:0@lo:400:kworker.0 00000100:00100000:0.0:1788837701.569313:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036940416:0@lo:400:kworker.0 00000100:00100000:0.0:1788837701.569354:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837701.569389:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036940928:0@lo:400:kworker.0 00000100:00100000:0.0:1788837701.569410:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837701.569425:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036941440:0@lo:400:kworker.0 00000100:00100000:0.0:1788837701.569447:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837701.569464:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788837701.569470:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036940544:0@lo:400:kworker.0 00000100:00100000:0.0:1788837701.569490:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837701.569503:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036941056:0@lo:400:kworker.0 00000100:00100000:0.0:1788837701.569537:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837701.569554:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036941568:0@lo:400:kworker.0 00000100:00100000:0.0:1788837701.569572:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837701.569601:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036940544 00000100:00100000:0.0:1788837701.569605:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036940544 00000100:00100000:0.0:1788837701.569638:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788837701.569646:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036940544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837701.569690:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036940544:12345-0@lo:400:kworker.0 Request processed in 44us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837701.569697:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788837701.569728:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036940416 00000100:00100000:0.0:1788837701.569731:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036940416 00000100:00100000:0.0:1788837701.569749:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036940928 00000100:00100000:0.0:1788837701.569752:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036940928 00000100:00100000:0.0:1788837701.569770:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036941440 00000100:00100000:0.0:1788837701.569796:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036941440 00000100:00100000:2.0:1788837701.570020:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036941824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837701.570048:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837701.570078:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036941824 00000100:00100000:2.0:1788837701.570082:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036941824 00000100:00100000:2.0:1788837701.570108:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788837701.570114:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036941824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837701.570141:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837701.570173:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036941824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837701.570179:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1788837701.570212:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2651180 x1875732036941824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837701.570229:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036941824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837701.570289:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788837701.570295:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036940416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837701.570323:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036940416:12345-0@lo:400:kworker.0 Request processed in 28us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837701.570337:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788837701.570348:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788837701.570353:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036940928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837701.570383:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036940928:12345-0@lo:400:kworker.0 Request processed in 30us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837701.570389:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788837701.570399:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788837701.570404:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036941440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837701.570427:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036941440:12345-0@lo:400:kworker.0 Request processed in 23us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837701.570433:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788837701.570454:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036941056 00000100:00100000:0.0:1788837701.570458:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036941056 00000100:00100000:0.0:1788837701.570484:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036941568 00000100:00100000:0.0:1788837701.570487:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036941568 00000100:00100000:0.0:1788837701.570505:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788837701.570512:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036941056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837701.570553:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036941056:12345-0@lo:400:kworker.0 Request processed in 41us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837701.570559:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788837701.570569:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788837701.570575:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036941568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837701.570597:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036941568:12345-0@lo:400:kworker.0 Request processed in 22us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837701.570602:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788837701.570629:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788837701.570932:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036940544:0@lo:400:kworker.0 00010000:00080000:0.0:1788837701.570944:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f6680 x1875732036941056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837701.570953:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036941056:0@lo:400:kworker.0 00010000:00080000:0.0:1788837701.570962:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac85eb100 x1875732036941568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837701.570970:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036941568:0@lo:400:kworker.0 00000100:00100000:0.0:1788837701.570981:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036940416:0@lo:400:kworker.0 00010000:00080000:0.0:1788837701.570990:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f7480 x1875732036940928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837701.570997:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036940928:0@lo:400:kworker.0 00010000:00080000:0.0:1788837701.571006:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f5880 x1875732036941440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837701.571013:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036941440:0@lo:400:kworker.0 00010000:00010000:2.0:1788837702.333224:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837702.585317:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837702.585340:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036941952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837702.585416:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837702.585559:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036941952 00000100:00100000:0.0:1788837702.585567:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036941952 00000100:00100000:0.0:1788837702.585617:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788837702.585626:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036941952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837702.585658:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788837702.585711:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036941952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837702.585718:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788837702.585885:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036941952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837702.643478:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837702.643529:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837702.643558:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837702.643577:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837702.643600:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837702.643749:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012745728 00000100:00100000:2.0:1788837702.643758:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012745728 00000100:00100000:2.0:1788837702.643807:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 310 00000100:00100000:2.0:1788837702.643815:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2394:x1875732012745728:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837702.643873:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2394:x1875732012745728:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 60us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837702.643878:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 310 00000100:00100000:0.0:1788837702.644616:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012745856 00000100:00100000:0.0:1788837702.644621:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012745856 00000100:00100000:0.0:1788837702.644656:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012746112 00000100:00100000:0.0:1788837702.644658:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012746112 00000100:00100000:0.0:1788837702.644666:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012745984 00000100:00100000:0.0:1788837702.644667:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012745984 00000100:00100000:0.0:1788837702.644675:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012746240 00000100:00100000:0.0:1788837702.644676:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012746240 00000100:00100000:0.0:1788837702.644685:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 172 00000100:00100000:0.0:1788837702.644690:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2393:x1875732012745856:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837702.644729:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2393:x1875732012745856:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 39us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837702.644734:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 172 00000100:00100000:0.0:1788837702.644743:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 173 00000100:00100000:0.0:1788837702.644746:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012746112:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837702.644760:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012746112:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 14us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837702.644764:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 173 00000100:00100000:0.0:1788837702.644770:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 174 00000100:00100000:0.0:1788837702.644773:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012745984:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837702.644812:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012745984:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 38us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837702.644815:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 174 00000100:00100000:0.0:1788837702.644822:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 175 00000100:00100000:0.0:1788837702.644826:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2394:x1875732012746240:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837702.644837:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2394:x1875732012746240:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 11us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837702.644846:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 175 00000100:00080000:2.0:1788837702.644916:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837702.644920:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1788837702.777504:0:13191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9b2a23a0 20000000:00000080:1.0:1788837702.777524:0:13191:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff889afc3f2800 uarg=0000000000000000 20000000:01000000:1.0:1788837702.777564:0:13191:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788837702.777570:0:13191:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788837702.777574:0:13191:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788837702.778563:0:13192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788837702.778702:0:13191:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788837702.783176:0:13191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788837702.783221:0:13191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837702.783242:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa790000/0x57f6d4e926aef005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aeeffe expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837702.783249:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa791400/0x57f6d4e926aef02f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef028 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837702.783257:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef059 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef052 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837702.783264:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b16800/0x57f6d4e926aef083 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef07c expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837702.783300:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef098 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e948 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837702.783416:0:13191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa6c9000/0x57f6d4e926aef0ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e987 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837702.783426:0:13191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837702.783470:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa6c9000/0x57f6d4e926aef0ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e987 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837702.783487:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889afa6c9000/0x57f6d4e926aef0ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e987 expref: 12 pid: 6518 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837702.783503:0:13191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1875732036942080:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788837702.783613:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e948 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837702.783622:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef098 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e948 expref: 12 pid: 6516 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837702.783631:0:13191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1875732036942208:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788837702.783664:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b16800/0x57f6d4e926aef083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aef07c expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837702.783672:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac2b16800/0x57f6d4e926aef083 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aef07c expref: 23 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837702.783692:0:13191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1875732036942336:0@lo:104: 00000100:00100000:1.0:1788837702.783733:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837702.784308:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036942336 00000100:00100000:0.0:1788837702.784326:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036942336 00000100:00100000:0.0:1788837702.784379:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788837702.784388:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:13191:x1875732036942336:12345-0@lo:104: 00010000:00010000:0.0:1788837702.784401:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef083 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.784454:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837702.784459:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:13191:x1875732036942336:12345-0@lo:104: Request processed in 73us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837702.784467:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1788837702.784491:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837702.784497:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef083 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.784504:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db400 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837702.784508:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aef083 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.784517:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aef083 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837702.784524:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aef083 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837702.784530:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837702.784564:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef083 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.784579:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837702.784600:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef083 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.784606:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6db400/0x57f6d4e926aef07c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef083 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.784619:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837702.784621:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837702.784622:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837702.784634:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036942464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837702.784663:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837702.784703:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036942464 00000100:00100000:0.0:1788837702.784707:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036942464 00010000:00010000:0.0:1788837702.784724:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b16800/0x57f6d4e926aef083 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aef07c expref: 24 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837702.784746:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837702.784753:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732036942464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837702.784762:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837702.784767:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b16800/0x57f6d4e926aef083 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aef07c expref: 24 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.784796:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b16800/0x57f6d4e926aef083 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aef07c expref: 24 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.784813:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837702.784842:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732036942464:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837702.784855:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837702.784893:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036942464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837702.784956:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef059 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aef052 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.784966:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef059 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aef052 expref: 23 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837702.784976:0:13191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3728380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1875732036942592:0@lo:104: 00000100:00100000:0.0:1788837702.785001:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837702.785021:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036942592 00000100:00100000:0.0:1788837702.785024:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036942592 00000100:00100000:0.0:1788837702.785047:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788837702.785053:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:13191:x1875732036942592:12345-0@lo:104: 00010000:00010000:0.0:1788837702.785061:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef059 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785093:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837702.785098:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:13191:x1875732036942592:12345-0@lo:104: Request processed in 46us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837702.785120:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1788837702.785153:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa791400/0x57f6d4e926aef02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aef028 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785162:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889afa791400/0x57f6d4e926aef02f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aef028 expref: 23 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837702.785171:0:13191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1875732036942720:0@lo:104: 00000100:00100000:0.0:1788837702.785212:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837702.785232:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036942720 00000100:00100000:0.0:1788837702.785236:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036942720 00000100:00100000:0.0:1788837702.785258:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788837702.785263:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2512680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:13191:x1875732036942720:12345-0@lo:104: 00010000:00010000:0.0:1788837702.785271:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef02f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785299:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788837702.785304:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2512680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:13191:x1875732036942720:12345-0@lo:104: Request processed in 42us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837702.785310:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1788837702.785337:0:13191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa790000/0x57f6d4e926aef005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aeeffe expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785346:0:13191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889afa790000/0x57f6d4e926aef005 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aeeffe expref: 23 pid: 6518 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837702.785354:0:13191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2512a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1875732036942848:0@lo:104: 00000100:00100000:0.0:1788837702.785376:0:13191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837702.785395:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036942848 00000100:00100000:0.0:1788837702.785398:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036942848 00000100:00100000:0.0:1788837702.785419:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837702.785425:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2513480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:13191:x1875732036942848:12345-0@lo:104: 00010000:00010000:0.0:1788837702.785433:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef005 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785462:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788837702.785467:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2513480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:13191:x1875732036942848:12345-0@lo:104: Request processed in 43us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837702.785480:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788837702.785495:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788837702.785499:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef059 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785506:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9800 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837702.785509:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aef059 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785517:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aef059 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837702.785525:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aef059 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837702.785530:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837702.785546:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef059 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785552:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837702.785568:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef059 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785576:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6c9800/0x57f6d4e926aef052 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef059 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785587:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837702.785590:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef02f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785606:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8000 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837702.785609:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aef02f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785616:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aef02f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837702.785624:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aef02f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837702.785629:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837702.785644:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef02f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785650:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837702.785657:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef02f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785663:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6c8000/0x57f6d4e926aef028 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef02f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785672:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837702.785675:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef005 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785681:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dba00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837702.785684:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aef005 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785700:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aef005 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837702.785707:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aef005 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837702.785712:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837702.785726:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef005 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785733:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837702.785744:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef005 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785751:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aeeffe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef005 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.785764:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837702.785766:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837702.785768:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837702.785808:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036942976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837702.785835:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837702.785859:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837702.785864:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036943104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837702.785884:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837702.785904:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837702.785909:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036943232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837702.785927:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837702.785952:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036942976 00000100:00100000:0.0:1788837702.785956:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036942976 00010000:00010000:0.0:1788837702.785970:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef059 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aef052 expref: 24 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837702.785985:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036943104 00000100:00100000:0.0:1788837702.785988:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036943104 00010000:00010000:0.0:1788837702.785997:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa791400/0x57f6d4e926aef02f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aef028 expref: 25 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837702.786006:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036943232 00000100:00100000:0.0:1788837702.786009:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036943232 00010000:00010000:0.0:1788837702.786016:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa790000/0x57f6d4e926aef005 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeffe expref: 26 pid: 6518 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837702.786027:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837702.786033:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+26:3648:x1875732036942976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837702.786042:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837702.786047:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef059 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aef052 expref: 26 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.786055:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef059 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aef052 expref: 26 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.786068:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837702.786091:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+26:3648:x1875732036942976:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837702.786098:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837702.786127:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788837702.786133:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2510a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+25:3648:x1875732036943104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837702.786150:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837702.786154:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa791400/0x57f6d4e926aef02f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aef028 expref: 25 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.786163:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa791400/0x57f6d4e926aef02f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aef028 expref: 25 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.786172:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837702.786191:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2510a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+25:3648:x1875732036943104:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837702.786197:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788837702.786208:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788837702.786214:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2511180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732036943232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837702.786220:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837702.786224:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa790000/0x57f6d4e926aef005 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aeeffe expref: 24 pid: 6518 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.786232:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa790000/0x57f6d4e926aef005 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aeeffe expref: 24 pid: 6518 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.786241:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837702.786264:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2511180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732036943232:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837702.786270:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788837702.786299:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036943232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837702.786317:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036943104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837702.786324:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036942976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837702.786352:0:13191:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac2b95240 going to sleep for 11 seconds 00010000:00010000:0.0:1788837702.786366:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b16800/0x57f6d4e926aef083 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aef07c expref: 23 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837702.786376:0:13191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1875732036942336:0@lo:104: 00010000:00010000:0.0:1788837702.786386:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef059 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aef052 expref: 22 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837702.786393:0:13191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3728380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1875732036942592:0@lo:104: 00010000:00010000:0.0:1788837702.786400:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa791400/0x57f6d4e926aef02f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aef028 expref: 21 pid: 6519 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837702.786407:0:13191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1875732036942720:0@lo:104: 00010000:00010000:0.0:1788837702.786414:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa790000/0x57f6d4e926aef005 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aeeffe expref: 20 pid: 6518 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837702.786422:0:13191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2512a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1875732036942848:0@lo:104: 00010000:00010000:2.0:1788837702.786795:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837702.789873:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837702.791416:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837702.791460:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837702.791558:0:13191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1875732036942080:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837702.791570:0:13191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13191:1875732036942208:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837702.791613:0:13191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837702.791681:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012746368 00000100:00100000:2.0:1788837702.791689:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012746368 00010000:00010000:2.0:1788837702.791727:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa6c9000/0x57f6d4e926aef0ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e987 expref: 13 pid: 6518 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837702.791762:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012746496 00000100:00100000:2.0:1788837702.791766:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012746496 00010000:00010000:2.0:1788837702.791811:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef098 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e948 expref: 14 pid: 6516 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837702.791836:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:2.0:1788837702.791846:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+14:2396:x1875732012746368:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837702.791863:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837702.791870:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa6c9000/0x57f6d4e926aef0ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e987 expref: 14 pid: 6518 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.791882:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa6c9000/0x57f6d4e926aef0ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e987 expref: 14 pid: 6518 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.791910:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c9000/0x57f6d4e926aef0ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e987 expref: 14 pid: 6518 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.791924:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837702.791975:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2396:x1875732012746368:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 130us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837702.791983:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:2.0:1788837702.791998:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:2.0:1788837702.792005:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:2396:x1875732012746496:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837702.792015:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837702.792020:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef098 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e948 expref: 12 pid: 6516 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.792029:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e948 expref: 12 pid: 6516 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.792038:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef098 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e948 expref: 12 pid: 6516 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.792049:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.792058:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.792073:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.792090:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.792097:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.792102:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.792120:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837702.792125:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.792132:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.792144:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837702.792153:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837702.792174:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:2396:x1875732012746496:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 169us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837702.792181:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 45 00010000:00010000:0.0:1788837702.792639:0:13191:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.792649:0:13191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837702.792664:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926aef0d0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788837703.107075:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 00000020:00000080:3.0:1788837703.107087:0:8433:0:(genops.c:885:class_export_put()) final put ffff8899c3240800/e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 00000020:00000080:1.0:1788837703.107604:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3240800/e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 for lustre-OST0000 00000020:00000080:1.0:1788837703.107657:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c3245000 for lustre-OST0000 00000001:00100000:0.0:1788837703.107744:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 00000020:00000080:0.0:1788837703.107749:0:9519:0:(genops.c:885:class_export_put()) final put ffff889af8dbc000/e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 00000020:00000080:1.0:1788837703.107818:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889af8dbc000/e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 for lustre-OST0001 00000020:00000080:1.0:1788837703.107838:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c321a800 for lustre-OST0001 00010000:00010000:0.0:1788837703.353065:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788837704.185003:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788837704.185011:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ae7ed4800 from 7 10000000:01000000:2.0:1788837704.185017:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837704.185068:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837704.185090:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837704.185109:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837704.185138:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036943360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837704.185211:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837704.185259:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7e99000 going to sleep for 11 seconds 00000100:00100000:2.0:1788837704.185282:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036943360 00000100:00100000:2.0:1788837704.185289:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036943360 00000100:00100000:2.0:1788837704.186583:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788837704.186595:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036943360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837704.186612:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837704.186633:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef0de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef0d7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837704.186665:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef0de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef0d7 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837704.186678:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef0de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef0d7 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837704.186691:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6db400, rc 0) 00000100:00100000:2.0:1788837704.186853:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036943360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 260us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837704.186860:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788837704.186914:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036943360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837704.186930:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef0de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837704.186946:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef0de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837704.187018:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036943488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837704.187048:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837704.187209:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036943488 00000100:00100000:0.0:1788837704.187215:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036943488 00000100:00100000:0.0:1788837704.187243:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788837704.187250:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036943488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837704.187388:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7e99000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837704.189014:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036943488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1758us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837704.189025:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788837704.189123:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036943488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837704.189172:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036943616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837704.189213:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837704.189248:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7e99000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837704.189288:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036943616 00000100:00100000:0.0:1788837704.189294:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036943616 00000100:00100000:0.0:1788837704.189406:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788837704.189417:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036943616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837704.189538:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036943616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837704.189548:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788837704.189592:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036943616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788837704.190813:0:13259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788837704.190891:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788837704.190915:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837704.190926:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef0de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837704.190948:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef0de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837704.190958:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788837704.190961:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889afa550800 from 7 10000000:01000000:0.0:1788837704.190964:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837704.190992:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837704.190999:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837704.191009:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837704.191029:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2512a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036943744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788837704.191073:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837704.191113:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af745b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837704.191133:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036943744 00000100:00100000:0.0:1788837704.191138:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036943744 00000100:00100000:0.0:1788837704.191168:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788837704.191176:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036943744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837704.191187:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837704.191200:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa790600/0x57f6d4e926aef0ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef0e5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837704.191221:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa790600/0x57f6d4e926aef0ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef0e5 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837704.191243:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa790600/0x57f6d4e926aef0ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef0e5 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837704.191252:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790600, rc 0) 00000100:00100000:0.0:1788837704.191283:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036943744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837704.191289:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788837704.191851:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2512a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036943744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837704.191866:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef0ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837704.191876:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef0ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837704.191942:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036943872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837704.191970:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837704.191986:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7e99480 going to sleep for 11 seconds 00000100:00100000:2.0:1788837704.191998:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036943872 00000100:00100000:2.0:1788837704.192002:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036943872 00000100:00100000:2.0:1788837704.192026:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788837704.192033:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036943872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837704.192153:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036943872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837704.192166:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788837704.192200:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036943872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837704.192229:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036944000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837704.192264:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837704.192277:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7e99480 going to sleep for 11 seconds 00000100:00100000:2.0:1788837704.192287:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036944000 00000100:00100000:2.0:1788837704.192291:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036944000 00000100:00100000:2.0:1788837704.192389:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788837704.192395:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036944000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837704.192468:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036944000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837704.192475:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788837704.192512:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036944000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788837704.193228:0:13260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788837704.193273:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788837704.193288:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837704.193296:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef0ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837704.196423:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef0ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837704.196503:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837704.196507:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ae7d4b000 from 7 10000000:01000000:3.0:1788837704.196510:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837704.196550:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837704.196560:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837704.196571:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837704.196595:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036944128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837704.196663:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837704.196710:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837704.197105:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036944128 00000100:00100000:2.0:1788837704.197113:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036944128 00000100:00100000:2.0:1788837704.197168:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788837704.197178:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036944128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837704.197202:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837704.197215:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6db800/0x57f6d4e926aef0fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef0f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837704.197239:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6db800/0x57f6d4e926aef0fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef0f3 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837704.197249:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6db800/0x57f6d4e926aef0fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef0f3 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837704.197257:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6db800, rc 0) 00000100:00100000:3.0:1788837704.197403:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036944128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837704.197417:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef0fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837704.197436:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef0fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837704.197495:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036944256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837704.197520:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837704.197547:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837704.197604:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036944256 00000100:00100000:1.0:1788837704.197608:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036944256 00000100:00100000:1.0:1788837704.197639:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788837704.197646:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036944256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837704.197747:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036944256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837704.197755:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788837704.197841:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036944128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837704.197848:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788837704.197945:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036944256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837704.197972:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036944384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837704.198011:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837704.198062:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837704.203357:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036944384 00000100:00100000:1.0:1788837704.203371:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036944384 00000100:00100000:3.0:1788837704.203530:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788837704.203540:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036944384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837704.203696:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036944384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (5683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837704.203704:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788837704.203764:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036944384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788837704.204521:0:13263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788837704.204586:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788837704.204605:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837704.204616:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef0fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837704.204628:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef0fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837704.204654:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837704.204657:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ac3ec4000 from 7 10000000:01000000:3.0:1788837704.204659:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837704.204691:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837704.204699:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837704.204708:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837704.204729:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036944512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837704.204795:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837704.204828:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac9699600 going to sleep for 11 seconds 00000100:00100000:3.0:1788837704.204843:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036944512 00000100:00100000:3.0:1788837704.204847:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036944512 00000100:00100000:3.0:1788837704.204875:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788837704.204883:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036944512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837704.204893:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837704.204905:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef108 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef101 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837704.204928:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef108 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef101 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837704.204940:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef108 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef101 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837704.204959:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17800, rc 0) 00000100:00100000:3.0:1788837704.204987:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036944512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837704.204994:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788837704.205027:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036944512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837704.205040:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef108 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837704.205048:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef108 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837704.205102:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036944640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837704.205127:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837704.205140:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae554e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837704.205150:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036944640 00000100:00100000:3.0:1788837704.205154:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036944640 00000100:00100000:3.0:1788837704.205173:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788837704.205180:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036944640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837704.205270:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036944640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837704.205277:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788837704.205304:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036944640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837704.205326:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036944768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837704.205359:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837704.205377:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae554e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837704.205388:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036944768 00000100:00100000:3.0:1788837704.205391:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036944768 00000100:00100000:3.0:1788837704.205411:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788837704.205417:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036944768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837704.205480:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036944768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837704.205487:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788837704.205520:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036944768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788837704.208544:0:13264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788837704.208747:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788837704.208769:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837704.208815:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef108 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837704.208827:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef108 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837704.382380:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837704.433337:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837704.433486:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012746624 00000100:00100000:3.0:1788837704.433496:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012746624 00000100:00100000:3.0:1788837704.433561:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 323 00000100:00100000:3.0:1788837704.433572:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:6167:x1875732012746624:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837704.433589:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837704.433608:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef10f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003e9b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837704.433638:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef10f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9b8 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837704.433650:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef10f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9b8 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837704.433659:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17e00, rc 0) 00000100:00100000:3.0:1788837704.433906:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:6167:x1875732012746624:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 334us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837704.433915:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 323 00000100:00100000:2.0:1788837704.444562:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837704.444705:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012746752 00000100:00100000:0.0:1788837704.444716:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012746752 00000100:00100000:0.0:1788837704.444772:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 324 00000100:00100000:0.0:1788837704.444812:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:6167:x1875732012746752:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837704.444956:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:6167:x1875732012746752:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 146us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837704.444964:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 324 00000100:00100000:0.0:1788837704.449263:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837704.452414:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012746880 00000100:00100000:3.0:1788837704.452435:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012746880 00000100:00100000:3.0:1788837704.452505:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 325 00000100:00100000:3.0:1788837704.452517:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:6167:x1875732012746880:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837704.452661:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:6167:x1875732012746880:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 147us (3410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837704.452670:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 325 00000100:00100000:3.0:1788837704.462073:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837704.462185:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012747008 00000100:00100000:1.0:1788837704.462195:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012747008 00000100:00100000:1.0:1788837704.462253:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 326 00000100:00100000:1.0:1788837704.462263:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:6167:x1875732012747008:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837704.462280:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837704.462308:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926aef116 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003e9bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837704.462340:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926aef116 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9bf expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837704.462361:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926aef116 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9bf expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837704.462373:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8c00, rc 0) 00000100:00100000:1.0:1788837704.462437:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:6167:x1875732012747008:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 176us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837704.462445:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 326 00000100:00100000:2.0:1788837704.476976:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837704.477024:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012747136 00000100:00100000:3.0:1788837704.477035:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012747136 00000100:00100000:3.0:1788837704.477098:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 327 00000100:00100000:3.0:1788837704.477108:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:6167:x1875732012747136:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837704.477248:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:6167:x1875732012747136:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 140us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837704.477256:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 327 00000100:00100000:2.0:1788837704.481554:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837704.481682:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012747264 00000100:00100000:3.0:1788837704.481692:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012747264 00000100:00100000:3.0:1788837704.481743:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 328 00000100:00100000:3.0:1788837704.481752:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:6167:x1875732012747264:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837704.481978:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:6167:x1875732012747264:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 226us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837704.481985:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 328 00000100:00100000:2.0:1788837705.150240:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837705.150264:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036944896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837705.150330:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837705.150387:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036944896 00000100:00100000:2.0:1788837705.150392:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036944896 00000100:00100000:2.0:1788837705.150430:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788837705.150437:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036944896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837705.150459:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837705.150487:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036944896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837705.150491:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788837705.150505:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788837705.150526:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac85e9f80 x1875732036944896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837705.150539:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036944896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837705.153415:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036945024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837705.153479:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837705.153565:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036945024 00000100:00100000:1.0:1788837705.153572:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036945024 00000100:00100000:1.0:1788837705.153633:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788837705.153635:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837705.153643:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036945024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837705.153666:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837705.153717:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036945024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837705.153724:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1788837705.153755:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2513b80 x1875732036945024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837705.153809:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036945024:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788837705.402304:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788837705.878660:0:13389:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788837706.425023:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837706.681071:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837706.681096:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036945152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837706.681169:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837706.681240:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036945152 00000100:00100000:2.0:1788837706.681246:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036945152 00000100:00100000:2.0:1788837706.681296:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788837706.681319:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036945152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837706.681349:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788837706.681374:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837706.681388:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036945280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837706.681394:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036945152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837706.681402:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788837706.681430:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036945536:0@lo:400:kworker.0 00000100:00100000:0.0:1788837706.681434:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837706.681474:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036945792:0@lo:400:kworker.0 00000100:00100000:2.0:1788837706.681476:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837706.681515:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036945536 00000100:00100000:0.0:1788837706.681520:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837706.681521:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036945536 00010000:00080000:2.0:1788837706.681525:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac85ebb80 x1875732036945152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837706.681548:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036945152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837706.681549:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036946304:0@lo:400:kworker.0 00000100:00100000:3.0:1788837706.681569:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788837706.681571:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036946048:0@lo:400:kworker.0 00000100:00100000:3.0:1788837706.681580:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036945536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837706.681585:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837706.681593:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837706.681611:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036946816:0@lo:400:kworker.0 00000100:00100000:2.0:1788837706.681613:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036946560:0@lo:400:kworker.0 00000100:00100000:3.0:1788837706.681631:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036945536:12345-0@lo:400:kworker.0 Request processed in 53us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837706.681644:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837706.681644:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837706.681648:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788837706.681671:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788837706.681675:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036945536:0@lo:400:kworker.0 00000100:00100000:0.0:1788837706.681678:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036945408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837706.681688:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788837706.681693:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036945664:0@lo:400:kworker.0 00000100:00100000:0.0:1788837706.681705:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837706.681709:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837706.681732:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036945920:0@lo:400:kworker.0 00000100:00100000:3.0:1788837706.681765:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036945280 00000100:00100000:3.0:1788837706.681770:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036945280 00000100:00100000:0.0:1788837706.681864:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036945792 00000100:00100000:2.0:1788837706.681873:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036946176:0@lo:400:kworker.0 00000100:00100000:0.0:1788837706.681875:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036945792 00000100:00100000:0.0:1788837706.681896:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036946048 00000100:00100000:0.0:1788837706.681906:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036946048 00000100:00100000:2.0:1788837706.681908:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837706.681918:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036945408 00000100:00100000:0.0:1788837706.681921:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036945408 00000100:00100000:2.0:1788837706.681925:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036946688:0@lo:400:kworker.0 00000100:00100000:0.0:1788837706.681939:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788837706.681946:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036945792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837706.681994:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036945792:12345-0@lo:400:kworker.0 Request processed in 42us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837706.682001:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788837706.682013:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837706.682013:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788837706.682027:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036946048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837706.682060:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036946304 00000100:00100000:2.0:1788837706.682064:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036946304 00000100:00100000:0.0:1788837706.682071:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036946048:12345-0@lo:400:kworker.0 Request processed in 47us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837706.682077:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788837706.682096:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788837706.682105:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036945408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837706.682132:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788837706.682166:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036945408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837706.682188:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788837706.682217:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036946816 00000100:00100000:0.0:1788837706.682221:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036946816 00000100:00100000:1.0:1788837706.683470:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036945664 00000100:00100000:3.0:1788837706.683479:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837706.683481:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036945664 00000100:00100000:3.0:1788837706.683490:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036945280:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837706.683509:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036946176 00002000:00000024:3.0:1788837706.683510:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837706.683515:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036946176 00000100:00100000:3.0:1788837706.683563:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036945280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (2137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837706.683570:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788837706.683611:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036946560 00000100:00100000:3.0:1788837706.683616:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036946560 00000100:00100000:2.0:1788837706.683637:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036946688 00000100:00100000:2.0:1788837706.683642:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036946688 00000100:00100000:3.0:1788837706.683653:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788837706.683663:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036946560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837706.683668:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788837706.683679:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036945664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837706.683704:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036946560:12345-0@lo:400:kworker.0 Request processed in 43us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837706.683712:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788837706.683728:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036945664:12345-0@lo:400:kworker.0 Request processed in 49us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837706.683736:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788837706.683750:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788837706.683757:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788837706.683762:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036946304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837706.683770:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036946688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837706.684211:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036946304:12345-0@lo:400:kworker.0 Request processed in 453us (2628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837706.684217:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788837706.684223:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036946688:12345-0@lo:400:kworker.0 Request processed in 455us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837706.684232:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788837706.684264:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036945664:0@lo:400:kworker.0 00000100:00080000:2.0:1788837706.684268:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837706.684272:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837706.684274:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837706.684294:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036946688:0@lo:400:kworker.0 00000100:00100000:2.0:1788837706.684301:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837706.684313:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036946048:0@lo:400:kworker.0 00010000:00080000:3.0:1788837706.684326:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7d47800 x1875732036946560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837706.684333:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036946560:0@lo:400:kworker.0 00000100:00100000:2.0:1788837706.684337:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036946432:0@lo:400:kworker.0 00000100:00100000:3.0:1788837706.684361:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036945920 00000100:00100000:3.0:1788837706.684365:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036945920 00000100:00100000:2.0:1788837706.684372:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837706.684388:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788837706.684393:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036945920:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788837706.684408:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7d45c00 x1875732036946304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837706.684420:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036945920:12345-0@lo:400:kworker.0 Request processed in 27us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837706.684422:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036946304:0@lo:400:kworker.0 00000100:00100000:3.0:1788837706.684428:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788837706.684448:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036945792:0@lo:400:kworker.0 00000100:00100000:3.0:1788837706.684452:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036946432 00000100:00100000:3.0:1788837706.684455:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036946432 00000100:00100000:3.0:1788837706.684471:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788837706.684475:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036946432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837706.684493:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036946432:12345-0@lo:400:kworker.0 Request processed in 18us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837706.684496:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1788837706.684542:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2511500 x1875732036945280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837706.684558:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036945280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837706.684595:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036945408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837706.684605:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036945920:0@lo:400:kworker.0 00010000:00080000:2.0:1788837706.684615:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7d46d80 x1875732036946432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837706.684623:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036946432:0@lo:400:kworker.0 00000100:00100000:1.0:1788837706.687154:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788837706.687171:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036946176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837706.687257:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036946176:12345-0@lo:400:kworker.0 Request processed in 92us (5348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837706.687264:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788837706.687337:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036946176:0@lo:400:kworker.0 00000100:00100000:0.0:1788837706.689625:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788837706.689640:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036946816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837706.689751:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036946816:12345-0@lo:400:kworker.0 Request processed in 115us (8108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837706.689758:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00010000:00080000:1.0:1788837706.689820:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7d44a80 x1875732036946816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837706.689855:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036946816:0@lo:400:kworker.0 00010000:00010000:0.0:1788837707.454959:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837707.708465:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036946944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837707.708560:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837707.708640:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036946944 00000100:00100000:3.0:1788837707.708649:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036946944 00000100:00100000:3.0:1788837707.708699:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788837707.708708:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036946944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837707.708749:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788837707.708818:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036946944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837707.708824:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788837707.708863:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036946944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837707.765519:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837707.765559:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837707.765577:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837707.765593:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837707.765612:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837707.765636:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012747392 00000100:00100000:3.0:1788837707.765644:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012747392 00000100:00100000:3.0:1788837707.765692:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 330 00000100:00100000:3.0:1788837707.765701:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2396:x1875732012747392:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837707.765761:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2396:x1875732012747392:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 62us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837707.765768:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 330 00000100:00100000:3.0:1788837707.765812:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012747648 00000100:00100000:3.0:1788837707.765816:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012747648 00000100:00100000:3.0:1788837707.765843:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012747904 00000100:00100000:3.0:1788837707.765845:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012747904 00000100:00100000:3.0:1788837707.765855:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012747520 00000100:00100000:3.0:1788837707.765857:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012747520 00000100:00100000:3.0:1788837707.765868:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012747776 00000100:00100000:3.0:1788837707.765870:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012747776 00000100:00100000:3.0:1788837707.765882:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 182 00000100:00100000:3.0:1788837707.765887:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012747648:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837707.765923:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012747648:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 35us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837707.765929:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 182 00000100:00100000:3.0:1788837707.765941:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 183 00000100:00100000:3.0:1788837707.765946:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012747904:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837707.765966:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012747904:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 21us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837707.765972:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 183 00000100:00100000:3.0:1788837707.765981:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 184 00000100:00100000:3.0:1788837707.765987:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2396:x1875732012747520:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837707.766005:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2396:x1875732012747520:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 19us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837707.766011:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 184 00000100:00100000:3.0:1788837707.766038:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 185 00000100:00100000:3.0:1788837707.766045:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012747776:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837707.766065:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012747776:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 21us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837707.766072:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 185 00000100:00080000:2.0:1788837707.766581:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837707.766586:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788837708.475821:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837709.497309:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837710.265573:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837710.265600:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036947072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837710.265675:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837710.265826:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036947072 00000100:00100000:3.0:1788837710.265835:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036947072 00000100:00100000:3.0:1788837710.265904:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788837710.265916:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036947072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788837710.265947:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837710.266011:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036947072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837710.266033:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1788837710.266081:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f7480 x1875732036947072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837710.266113:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036947072:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788837710.266387:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837710.266651:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837710.266662:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036947200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837710.266697:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837710.271530:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036947200 00000100:00100000:0.0:1788837710.271546:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036947200 00000100:00100000:0.0:1788837710.271633:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788837710.271644:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036947200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837710.271675:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1788837710.271953:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2513800 x1875732036947200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837710.271989:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036947200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837710.272097:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036947200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 452us (5396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837710.272105:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788837710.272435:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837710.521682:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788837711.525903:0:13538:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:21:50 (1788837710) === 00010000:00010000:2.0:1788837711.544929:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837711.802244:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036947328:0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.802325:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.802385:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036947840:0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.802411:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.802431:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036948352:0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.802454:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.802471:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036948864:0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.802491:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.802514:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788837711.802521:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036947456:0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.802544:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.802564:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036947968:0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.802583:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.802616:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036948480:0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.802637:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.802653:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036948992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837711.802675:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.802708:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036947584:0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.802731:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.802750:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036948096:0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.802769:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.802806:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036948608:0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.802826:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.802837:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788837711.802842:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036947712:0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.802860:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.802870:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036948224:0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.802888:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.802906:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036948736:0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.802925:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.802990:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036947328 00000100:00100000:2.0:1788837711.802998:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036947328 00000100:00100000:1.0:1788837711.803046:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837711.803059:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788837711.803061:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036949120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837711.803074:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3650:x1875732036947328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837711.803098:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837711.803144:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3650:x1875732036947328:12345-0@lo:400:kworker.0 Request processed in 73us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837711.803151:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036947456 00000100:00100000:2.0:1788837711.803154:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788837711.803157:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036947456 00000100:00100000:1.0:1788837711.803184:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036947968 00000100:00100000:1.0:1788837711.803187:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036947968 00000100:00100000:2.0:1788837711.803198:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036947840 00000100:00100000:2.0:1788837711.803211:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036947840 00000100:00100000:1.0:1788837711.803213:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036948480 00000100:00100000:1.0:1788837711.803218:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036948480 00000100:00100000:2.0:1788837711.803240:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036947584 00000100:00100000:1.0:1788837711.803242:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036948096 00000100:00100000:2.0:1788837711.803246:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036947584 00000100:00100000:1.0:1788837711.803247:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036948096 00000100:00100000:2.0:1788837711.803275:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036949120 00000100:00100000:1.0:1788837711.803275:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036948608 00000100:00100000:2.0:1788837711.803280:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036949120 00000100:00100000:1.0:1788837711.803281:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036948608 00000100:00100000:1.0:1788837711.803310:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036947712 00000100:00100000:2.0:1788837711.803314:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788837711.803314:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036947712 00000100:00100000:2.0:1788837711.803327:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036947840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837711.803333:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788837711.803342:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036947456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.803372:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036947840:12345-0@lo:400:kworker.0 Request processed in 48us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837711.803380:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788837711.803387:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036947456:12345-0@lo:400:kworker.0 Request processed in 46us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837711.803396:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788837711.803400:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788837711.803409:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036947584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837711.803417:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788837711.803425:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036947968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.803451:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036947584:12345-0@lo:400:kworker.0 Request processed in 43us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837711.803459:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788837711.803470:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036947968:12345-0@lo:400:kworker.0 Request processed in 45us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837711.803478:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788837711.803479:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788837711.803491:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036949120:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837711.803498:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788837711.803505:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036948480:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1788837711.803517:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788837711.803531:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036948480:12345-0@lo:400:kworker.0 Request processed in 26us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837711.803537:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788837711.803549:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788837711.803556:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036948096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.803565:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036949120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837711.803573:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788837711.803589:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036948096:12345-0@lo:400:kworker.0 Request processed in 33us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837711.803597:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788837711.803600:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036948352 00000100:00100000:2.0:1788837711.803605:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036948352 00000100:00100000:1.0:1788837711.803612:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788837711.803620:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036948608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.803631:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036948864 00000100:00100000:2.0:1788837711.803635:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036948864 00000100:00100000:1.0:1788837711.803646:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036948608:12345-0@lo:400:kworker.0 Request processed in 27us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837711.803654:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788837711.803655:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036948224 00000100:00100000:2.0:1788837711.803659:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036948224 00000100:00100000:1.0:1788837711.803670:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788837711.803676:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036948736 00000100:00100000:1.0:1788837711.803681:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036947712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.803682:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036948736 00000100:00100000:1.0:1788837711.803712:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036947712:12345-0@lo:400:kworker.0 Request processed in 35us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837711.803717:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788837711.803722:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788837711.803730:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036948352:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788837711.803741:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837711.803748:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837711.803757:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837711.804269:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788837711.804278:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036948864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837711.804348:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036949120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837711.804370:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036949248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837711.839548:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036948352:12345-0@lo:400:kworker.0 Request processed in 35810us (37082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837711.839564:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788837711.839602:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036948864:12345-0@lo:400:kworker.0 Request processed in 35321us (37105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837711.839607:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788837711.839617:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788837711.839625:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036948224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837711.839641:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788837711.839651:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036948736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837711.839705:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036948224:12345-0@lo:400:kworker.0 Request processed in 86us (36814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837711.839708:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036948736:12345-0@lo:400:kworker.0 Request processed in 58us (36780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837711.839718:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837711.842751:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837711.842825:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036948992 00000100:00100000:1.0:1788837711.842835:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036948992 00000100:00100000:1.0:1788837711.842875:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036949248 00000100:00100000:1.0:1788837711.842878:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036949248 00000100:00100000:1.0:1788837711.842893:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788837711.842903:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875732036948992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788837711.842933:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837711.842995:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875732036948992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (40317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837711.843002:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788837711.843019:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788837711.843025:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036949248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837711.843034:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837711.843060:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036949248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837711.843066:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1788837711.843116:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7d44a80 x1875732036949248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837711.843135:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036949248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837711.843373:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036947712:0@lo:400:kworker.0 00010000:00080000:0.0:1788837711.843403:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f4a80 x1875732036948224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837711.843415:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036948224:0@lo:400:kworker.0 00010000:00080000:0.0:1788837711.843433:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6ef480 x1875732036948736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837711.843455:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036947456:0@lo:400:kworker.0 00000100:00100000:0.0:1788837711.843461:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036948736:0@lo:400:kworker.0 00000100:00100000:1.0:1788837711.843473:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036947968:0@lo:400:kworker.0 00000100:00100000:0.0:1788837711.843484:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036947584:0@lo:400:kworker.0 00000100:00100000:1.0:1788837711.843501:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036948480:0@lo:400:kworker.0 00010000:00080000:0.0:1788837711.843505:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f6d80 x1875732036948096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837711.843516:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036948096:0@lo:400:kworker.0 00010000:00080000:1.0:1788837711.843519:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6efb80 x1875732036948992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788837711.843535:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6eca80 x1875732036948608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837711.843536:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036948992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837711.843552:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036948608:0@lo:400:kworker.0 00000100:00100000:1.0:1788837711.843556:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036947328:0@lo:400:kworker.0 00000100:00100000:1.0:1788837711.843574:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036947840:0@lo:400:kworker.0 00010000:00080000:1.0:1788837711.843592:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afc3f6300 x1875732036948352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837711.843601:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036948352:0@lo:400:kworker.0 00010000:00080000:1.0:1788837711.843612:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa6ece00 x1875732036948864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837711.843620:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036948864:0@lo:400:kworker.0 00000100:00100000:3.0:1788837711.846368:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788837712.192007:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837712.192062:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837712.192161:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012748032 00000100:00100000:0.0:1788837712.192167:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012748160 00000100:00100000:1.0:1788837712.192174:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012748032 00000100:00100000:0.0:1788837712.192174:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012748160 00000100:00100000:0.0:1788837712.192252:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:1.0:1788837712.192253:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:0.0:1788837712.192268:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:3a879e24-3b2f-4404-84c2-9101689d9315+7:10475:x1875732012748160:12345-192.168.201.3@tcp:700:mkdir.0 00000100:00100000:1.0:1788837712.192269:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012748032:12345-192.168.201.3@tcp:41:mkdir.0 00000004:00000024:1.0:1788837712.192316:0:9317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788837712.192360:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:3a879e24-3b2f-4404-84c2-9101689d9315+7:10475:x1875732012748160:12345-192.168.201.3@tcp:700:mkdir.0 Request processed in 96us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837712.192369:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:1.0:1788837712.192379:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012748032:12345-192.168.201.3@tcp:41:mkdir.0 Request processed in 114us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837712.192387:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00080000:2.0:1788837712.192497:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837712.197530:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837712.197677:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012748416 00000100:00100000:1.0:1788837712.197687:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012748416 00000100:00100000:1.0:1788837712.197765:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:1.0:1788837712.197802:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:10475:x1875732012748416:12345-192.168.201.3@tcp:36:mkdir.0 00010000:00010000:1.0:1788837712.197858:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837712.197887:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aeefbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e933 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.197907:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ac3da1b00) 00010000:00010000:1.0:1788837712.197933:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837712.198042:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef11d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198065:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef11d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198077:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef11d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198130:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef124 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198139:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef124 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198145:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef124 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198665:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef12b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198675:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef12b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198692:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef12b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837712.198708:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8a45de3 reply state 00000000c66b649d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef12b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198719:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef12b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198725:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889ae0332a00) 00010000:00010000:1.0:1788837712.198728:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788837712.198731:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788837712.198735:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788837712.198743:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef11d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198749:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef11d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198756:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef11d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198762:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837712.198767:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef11d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198815:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef11d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198825:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ae0332f00) 00010000:00010000:1.0:1788837712.198827:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837712.198838:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef11d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198844:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef11d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837712.198857:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8a45de3 reply state 00000000c66b649d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef124 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198865:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef124 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.198871:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff889ae0332d00) 00010000:00010000:1.0:1788837712.198873:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788837712.198875:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788837712.198966:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:10475:x1875732012748416:12345-192.168.201.3@tcp:36:mkdir.0 Request processed in 1192us (1445us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788837712.198975:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:3.0:1788837712.214828:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837712.214939:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012748544 00000100:00100000:1.0:1788837712.214959:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012748544 00000100:00100000:1.0:1788837712.215031:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:1.0:1788837712.215043:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:10476:x1875732012748544:12345-192.168.201.3@tcp:101:chmod.0 00010000:00010000:1.0:1788837712.215064:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837712.215086:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003e9c6 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.215172:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef139 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.215187:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef139 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.215218:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef139 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837712.215264:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788837712.215268:0:9317:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837712.215311:0:9317:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef139 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.215340:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9c6 expref: 9 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.215360:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef139 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9c6 expref: 8 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.215369:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ae0332f00) 00010000:00010000:1.0:1788837712.215371:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837712.215375:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9200, rc 0) 00000100:00100000:1.0:1788837712.215510:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+8:10476:x1875732012748544:12345-192.168.201.3@tcp:101:chmod.0 Request processed in 468us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837712.215518:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:2.0:1788837712.241173:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837712.241324:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012748800 00000100:00100000:3.0:1788837712.241333:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012748800 00000100:00100000:3.0:1788837712.241406:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:3.0:1788837712.241415:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+8:10476:x1875732012748800:12345-192.168.201.3@tcp:36:chmod.0 00010000:00010000:3.0:1788837712.241466:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837712.241491:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef139 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9c6 expref: 8 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.241513:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ae0332f00) 00010000:00010000:3.0:1788837712.241522:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837712.241546:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef140 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.241558:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef140 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.241567:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef140 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837712.241742:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc66c231 reply state 000000006839ead1 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef140 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.241755:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef140 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.241761:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8899c3351700) 00010000:00010000:3.0:1788837712.241764:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788837712.241766:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788837712.241818:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788837712.241898:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+9:10476:x1875732012748800:12345-192.168.201.3@tcp:36:chmod.0 Request processed in 483us (733us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788837712.241905:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:3.0:1788837712.279231:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837712.279383:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012748928 00000100:00100000:1.0:1788837712.279392:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012748928 00000100:00100000:1.0:1788837712.279448:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:1.0:1788837712.279457:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+9:10477:x1875732012748928:12345-192.168.201.3@tcp:101:chown.0 00010000:00010000:1.0:1788837712.279480:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837712.279500:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef147 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003e9cd expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.279587:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8e00/0x57f6d4e926aef14e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.279602:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8e00/0x57f6d4e926aef14e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.279613:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8e00/0x57f6d4e926aef14e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837712.279655:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788837712.279659:0:9317:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837712.279693:0:9317:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8e00/0x57f6d4e926aef14e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.279716:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef147 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9cd expref: 11 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.279733:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8e00/0x57f6d4e926aef14e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9cd expref: 10 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.279742:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8899c3351700) 00010000:00010000:1.0:1788837712.279745:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837712.279748:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8e00, rc 0) 00000100:00100000:1.0:1788837712.279850:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+10:10477:x1875732012748928:12345-192.168.201.3@tcp:101:chown.0 Request processed in 393us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837712.279857:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:0.0:1788837712.284075:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837712.284237:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012749056 00000100:00100000:3.0:1788837712.284247:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012749056 00000100:00100000:3.0:1788837712.284298:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:3.0:1788837712.284307:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+10:10477:x1875732012749056:12345-192.168.201.3@tcp:101:chown.0 00010000:00010000:3.0:1788837712.284326:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837712.284344:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef155 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003e9d4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284405:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030600/0x57f6d4e926aef15c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284428:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030600/0x57f6d4e926aef15c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284439:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030600/0x57f6d4e926aef15c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284449:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef163 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284456:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284462:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284533:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef16a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284540:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef16a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284561:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef16a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837712.284602:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788837712.284606:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837712.284626:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef16a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284637:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030600/0x57f6d4e926aef15c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284644:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030600/0x57f6d4e926aef15c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284652:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030600/0x57f6d4e926aef15c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284658:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0030600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837712.284662:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030600/0x57f6d4e926aef15c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284670:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030600/0x57f6d4e926aef15c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284682:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8899c3351700) 00010000:00010000:3.0:1788837712.284684:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837712.284689:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030600/0x57f6d4e926aef15c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284695:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030600/0x57f6d4e926aef15c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284719:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284725:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef163 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284730:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284735:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0031800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837712.284737:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284743:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef163 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284750:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff889ae0332d00) 00010000:00010000:3.0:1788837712.284753:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837712.284756:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef163 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284761:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef163 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284831:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef155 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9d4 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284845:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef16a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9d4 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837712.284863:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889ae0332a00) 00010000:00010000:3.0:1788837712.284866:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837712.284868:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0030e00, rc 0) 00000100:00100000:3.0:1788837712.284921:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+11:10477:x1875732012749056:12345-192.168.201.3@tcp:101:chown.0 Request processed in 614us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837712.284928:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:3.0:1788837712.300072:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837712.300843:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012749184 00000100:00100000:2.0:1788837712.300853:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012749184 00000100:00100000:2.0:1788837712.300916:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:2.0:1788837712.300926:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3a879e24-3b2f-4404-84c2-9101689d9315+11:10477:x1875732012749184:12345-192.168.201.3@tcp:900:chown.0 00000100:00100000:2.0:1788837712.301030:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3a879e24-3b2f-4404-84c2-9101689d9315+11:10477:x1875732012749184:12345-192.168.201.3@tcp:900:chown.0 Request processed in 105us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837712.301037:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:0.0:1788837712.307110:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837712.307233:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012749440 00000100:00100000:1.0:1788837712.307243:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012749440 00000100:00100000:1.0:1788837712.307310:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:1.0:1788837712.307319:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+11:10477:x1875732012749440:12345-192.168.201.3@tcp:36:chown.0 00010000:00010000:1.0:1788837712.307371:0:9317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837712.307398:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef16a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9d4 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.307418:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889ae0332a00) 00010000:00010000:1.0:1788837712.307424:0:9317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837712.307445:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef171 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.307457:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef171 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.307467:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef171 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837712.313865:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:1.0:1788837712.314100:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef124 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314112:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef124 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314119:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef124 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314137:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837712.314141:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef124 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314148:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef124 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314184:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff889ae0332d00) 00010000:00010000:1.0:1788837712.314187:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837712.314192:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef124 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314198:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef124 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314218:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef12b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314224:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef12b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314229:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef12b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314234:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837712.314236:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef12b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314241:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef12b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314249:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889ae0332a00) 00010000:00010000:1.0:1788837712.314251:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837712.314254:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef12b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314260:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef12b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314284:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef140 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314290:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef140 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314295:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef140 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314300:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837712.314303:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef140 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314309:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef140 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314330:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8899c3351700) 00010000:00010000:1.0:1788837712.314333:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788837712.314354:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef140 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.314361:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef140 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837712.315279:0:9317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008dd8ef03 reply state 00000000044688a5 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef171 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.315297:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef171 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.315304:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889ae0332a00) 00010000:00010000:2.0:1788837712.315316:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788837712.315320:0:9317:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788837712.315332:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1788837712.315431:0:9317:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788837712.315449:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:10477:x1875732012749440:12345-192.168.201.3@tcp:36:chown.0 Request processed in 8127us (8346us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788837712.315458:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 28 00010000:00010000:1.0:1788837712.315584:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef171 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.315594:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef171 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.315601:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef171 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.315612:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837712.315615:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef171 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.315622:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef171 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.315631:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889ae0332a00) 00010000:00010000:1.0:1788837712.315633:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788837712.315635:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef171 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.315640:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef171 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837712.359430:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837712.359826:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012749568 00000100:00100000:3.0:1788837712.359838:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012749568 00000100:00100000:3.0:1788837712.359902:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:3.0:1788837712.359912:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:10478:x1875732012749568:12345-192.168.201.3@tcp:101:touch.500 00010000:00010000:3.0:1788837712.359946:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837712.359969:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003e9db expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788837712.361915:0:6526:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1880us 00010000:00010000:0.0:1788837712.399340:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef17f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399378:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef17f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399390:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef17f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399406:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef186 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399424:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399430:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399525:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926aef18d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399533:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926aef18d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399540:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926aef18d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837712.399570:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788837712.399574:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788837712.399610:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926aef18d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399621:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef17f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399637:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef17f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399644:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef17f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399649:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837712.399653:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef17f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399660:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef17f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399671:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8899c3351700) 00010000:00010000:0.0:1788837712.399675:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837712.399680:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef17f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399685:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef17f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399699:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399706:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef186 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399712:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef186 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399717:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837712.399724:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef186 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399730:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef186 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399737:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff889af8da5500) 00010000:00010000:0.0:1788837712.399739:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837712.399742:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef186 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399747:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef186 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399836:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9db expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399863:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926aef18d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9db expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.399871:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889af8da5a00) 00010000:00010000:0.0:1788837712.399874:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788837712.399876:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790000, rc 0) 00000100:00100000:0.0:1788837712.399971:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:10478:x1875732012749568:12345-192.168.201.3@tcp:101:touch.500 Request processed in 40060us (40561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837712.399981:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:3.0:1788837712.403391:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837712.403516:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012749824 00000100:00100000:0.0:1788837712.403526:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012749824 00000100:00100000:0.0:1788837712.403587:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:0.0:1788837712.403598:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+7:10478:x1875732012749824:12345-192.168.201.3@tcp:101:touch.500 00010000:00010000:0.0:1788837712.403627:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837712.403655:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef194 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003e9e2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.403762:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef19b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.403804:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef19b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.403823:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef19b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.403904:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef1a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.403913:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef1a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.403927:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef1a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788837712.404383:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788837712.404771:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790e00/0x57f6d4e926aef1a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.404818:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790e00/0x57f6d4e926aef1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.404834:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790e00/0x57f6d4e926aef1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.404963:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef19b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.404971:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef19b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.404977:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef19b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.404982:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837712.404986:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef19b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.404993:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef19b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.405012:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889af8da5a00) 00010000:00010000:0.0:1788837712.405015:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837712.405020:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef19b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.405025:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef19b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837712.405042:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abcdf3b9 reply state 00000000319812c4 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef1a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.405053:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef1a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.405060:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff889af8da5300) 00010000:00010000:0.0:1788837712.405067:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788837712.405070:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788837712.405108:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef194 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9e2 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.405271:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790e00/0x57f6d4e926aef1a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9e2 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.405279:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff889af8da5b00) 00010000:00010000:0.0:1788837712.405281:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837712.405283:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790e00, rc 0) 00000100:00100000:1.0:1788837712.405485:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+10:10478:x1875732012749824:12345-192.168.201.3@tcp:101:touch.500 Request processed in 1886us (2100us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788837712.405492:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:3.0:1788837712.410254:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837712.410435:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012750080 00000100:00100000:1.0:1788837712.410447:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012750080 00000100:00100000:1.0:1788837712.410516:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:1.0:1788837712.410526:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+10:10478:x1875732012750080:12345-192.168.201.3@tcp:36:touch.500 00010000:00010000:1.0:1788837712.410593:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837712.410620:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790e00/0x57f6d4e926aef1a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9e2 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.410643:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff889af8da5b00) 00010000:00010000:1.0:1788837712.410652:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837712.410718:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef1b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.410734:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef1b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.410743:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef1b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837712.411095:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073638463 reply state 0000000078ea6408 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef1b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.411108:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef1b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.411114:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff889ae0332a00) 00010000:00010000:1.0:1788837712.411116:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788837712.411119:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788837712.411255:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+11:10478:x1875732012750080:12345-192.168.201.3@tcp:36:touch.500 Request processed in 729us (1010us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788837712.411262:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:0.0:1788837712.432882:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837712.433045:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012750208 00000100:00100000:2.0:1788837712.433056:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012750208 00000100:00100000:2.0:1788837712.433131:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:2.0:1788837712.433151:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+11:10478:x1875732012750208:12345-192.168.201.3@tcp:101:touch.500 00010000:00010000:2.0:1788837712.433178:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837712.433200:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926aef1be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003e9e9 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.433258:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926aef1be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9e9 expref: 12 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.433271:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926aef1be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9e9 expref: 12 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.433289:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff889ae0332a00) 00010000:00010000:2.0:1788837712.433292:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837712.433295:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6dbc00, rc 0) 00000100:00100000:2.0:1788837712.433355:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+12:10478:x1875732012750208:12345-192.168.201.3@tcp:101:touch.500 Request processed in 214us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837712.433362:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:1.0:1788837712.439747:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837712.440017:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012750336 00000100:00100000:3.0:1788837712.440027:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012750336 00000100:00100000:3.0:1788837712.440223:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:3.0:1788837712.440232:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875732012750336:12345-192.168.201.3@tcp:8:touch.500 00010000:00080000:3.0:1788837712.440267:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:3.0:1788837712.440310:0:8441:0:(genops.c:1385:class_connect()) connect: client 3a879e24-3b2f-4404-84c2-9101689d9315, cookie 0x57f6d4e926aef1c5 00002000:00100000:3.0:1788837712.440323:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3a879e24-3b2f-4404-84c2-9101689d9315/ffff8899c3647000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788837712.440356:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788837712.440442:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788837712.440472:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8899c3640800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837712.440546:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2392:x1875732012750336:12345-192.168.201.3@tcp:8:touch.500 Request processed in 313us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837712.445318:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:1.0:1788837712.450065:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837712.450310:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012750464 00000100:00100000:2.0:1788837712.450337:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012750464 00000100:00100000:2.0:1788837712.450429:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:2.0:1788837712.450439:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:0:x1875732012750464:12345-192.168.201.3@tcp:2:touch.500 00000100:00080000:1.0:1788837712.451956:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788837712.459012:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1788837712.459026:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3a879e24-3b2f-4404-84c2-9101689d9315 00000100:00100000:2.0:1788837712.459244:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:0:x1875732012750464:12345-192.168.201.3@tcp:2:touch.500 Request processed in 8800us (9183us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788837712.459255:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:0.0:1788837712.462467:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837712.462574:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012750720 00000100:00100000:2.0:1788837712.462586:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012750720 00000100:00100000:2.0:1788837712.462649:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:2.0:1788837712.462660:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+12:10478:x1875732012750720:12345-192.168.201.3@tcp:35:touch.500 00000100:00100000:2.0:1788837712.463009:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+13:10478:x1875732012750720:12345-192.168.201.3@tcp:35:touch.500 Request processed in 351us (552us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788837712.463017:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:1.0:1788837712.502985:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837712.503154:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012750848 00000100:00100000:0.0:1788837712.503164:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012750848 00000100:00100000:0.0:1788837712.503226:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:0.0:1788837712.503236:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+13:10479:x1875732012750848:12345-192.168.201.3@tcp:101:rm.0 00010000:00010000:0.0:1788837712.503259:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837712.503279:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef1cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003e9f0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.503346:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef1d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.503360:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.503372:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837712.503443:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788837712.503446:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788837712.503483:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.503509:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef1cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9f0 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.503531:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9f0 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.503540:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889af8da5a00) 00010000:00010000:0.0:1788837712.503542:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837712.503545:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790a00, rc 0) 00000100:00100000:0.0:1788837712.503842:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+14:10479:x1875732012750848:12345-192.168.201.3@tcp:101:rm.0 Request processed in 607us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837712.503859:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:1.0:1788837712.518593:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837712.518702:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012751104 00000100:00100000:2.0:1788837712.518713:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012751104 00000100:00100000:2.0:1788837712.518773:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:2.0:1788837712.518816:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+14:10479:x1875732012751104:12345-192.168.201.3@tcp:101:rm.0 00010000:00010000:2.0:1788837712.518837:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837712.518869:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aef1da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003e9f7 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837712.518978:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788837712.519134:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aef1da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9f7 expref: 16 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.519156:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8899c3351700) 00010000:00010000:2.0:1788837712.519165:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837712.519170:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aef1da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9f7 expref: 16 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.519192:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6db000, rc 0) 00000100:00100000:2.0:1788837712.519758:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+15:10479:x1875732012751104:12345-192.168.201.3@tcp:101:rm.0 Request processed in 942us (1172us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788837712.519766:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:3.0:1788837712.531446:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837712.531771:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012751232 00000100:00100000:2.0:1788837712.531818:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012751232 00000100:00100000:2.0:1788837712.531889:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:2.0:1788837712.531900:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+15:10479:x1875732012751232:12345-192.168.201.3@tcp:37:rm.0 00000100:00100000:2.0:1788837712.538366:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+15:10479:x1875732012751232:12345-192.168.201.3@tcp:37:rm.0 Request processed in 6458us (6921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837712.538380:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:1.0:1788837712.542278:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837712.542375:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012751488 00000100:00100000:3.0:1788837712.542386:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012751488 00000100:00100000:3.0:1788837712.542456:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:3.0:1788837712.542466:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8e7a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+15:10479:x1875732012751488:12345-192.168.201.3@tcp:35:rm.0 00000100:00100000:3.0:1788837712.542700:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8e7a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+16:10479:x1875732012751488:12345-192.168.201.3@tcp:35:rm.0 Request processed in 236us (434us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788837712.542723:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:3.0:1788837712.549546:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837712.549653:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012751744 00000100:00100000:1.0:1788837712.549662:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012751744 00000100:00100000:1.0:1788837712.549729:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:1.0:1788837712.549740:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+16:10479:x1875732012751744:12345-192.168.201.3@tcp:101:rm.0 00010000:00010000:1.0:1788837712.549816:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837712.549839:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef1e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003e9fe expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.550132:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef1ef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.550158:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef1ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.550170:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef1ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837712.550181:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788837712.550333:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef1e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9fe expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.550353:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef1ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9fe expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837712.550361:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889af8da5a00) 00010000:00010000:1.0:1788837712.550364:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788837712.550367:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9200, rc 0) 00000100:00100000:1.0:1788837712.550638:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+18:10479:x1875732012751744:12345-192.168.201.3@tcp:101:rm.0 Request processed in 899us (1102us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788837712.550646:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:1.0:1788837712.555881:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837712.555974:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012751872 00000100:00100000:2.0:1788837712.555985:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012751872 00000100:00100000:2.0:1788837712.556047:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:2.0:1788837712.556057:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+18:10479:x1875732012751872:12345-192.168.201.3@tcp:41:rm.0 00000004:00000024:2.0:1788837712.556140:0:9317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1788837712.556225:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+18:10479:x1875732012751872:12345-192.168.201.3@tcp:41:rm.0 Request processed in 170us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837712.556232:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:3.0:1788837712.559392:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837712.559560:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012752000 00000100:00100000:0.0:1788837712.559572:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012752000 00000100:00100000:0.0:1788837712.559635:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 37 00000100:00100000:0.0:1788837712.559645:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+18:10479:x1875732012752000:12345-192.168.201.3@tcp:101:rm.0 00010000:00010000:0.0:1788837712.559667:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837712.559689:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef1fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea05 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.559758:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef204 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.559823:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef204 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.559834:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef204 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.559847:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef20b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.559865:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef20b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.559871:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef20b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.559969:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef212 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.559978:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.559985:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837712.560018:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788837712.560023:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788837712.560039:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560051:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef212 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560070:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef204 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560078:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef204 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560084:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef204 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560090:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837712.560094:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef204 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560103:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef204 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560115:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889af8da5a00) 00010000:00010000:0.0:1788837712.560118:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837712.560123:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef204 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560128:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef204 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560144:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef20b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560151:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef20b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560157:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef20b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560168:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837712.560171:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef20b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560177:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef20b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560185:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff889af8da5300) 00010000:00010000:0.0:1788837712.560187:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837712.560190:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef20b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560196:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef20b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560220:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef1fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea05 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560233:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef212 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea05 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.560239:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff889ae0332a00) 00010000:00010000:0.0:1788837712.560242:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837712.560244:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791800, rc 0) 00000100:00100000:0.0:1788837712.560307:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+19:10479:x1875732012752000:12345-192.168.201.3@tcp:101:rm.0 Request processed in 663us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837712.560315:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 37 00000100:00100000:3.0:1788837712.568083:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00010000:00010000:0.0:1788837712.570422:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837712.575349:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012752256 00000100:00100000:2.0:1788837712.575365:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012752256 00000100:00100000:2.0:1788837712.575455:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:2.0:1788837712.575466:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+19:10479:x1875732012752256:12345-192.168.201.3@tcp:36:rm.0 00010000:00010000:2.0:1788837712.575532:0:9317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788837712.575559:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef212 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea05 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.575584:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926aef1be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9e9 expref: 18 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.575595:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff889ae0332a00) 00010000:00010000:2.0:1788837712.575606:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef1d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9f0 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.575615:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889af8da5a00) 00010000:00010000:2.0:1788837712.575618:0:9317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837712.575638:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aef219 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.575651:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aef219 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.575661:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aef219 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.575671:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef220 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.575678:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef220 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.575685:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef220 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.575801:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da000/0x57f6d4e926aef227 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.575810:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da000/0x57f6d4e926aef227 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.575816:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da000/0x57f6d4e926aef227 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837712.576040:0:9317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788837712.576050:0:9317:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329447273071ns, next at 330447270832ns, rc = 0 00010000:00010000:2.0:1788837712.576092:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef22e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.576101:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef22e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.576107:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef22e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.576114:0:9317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef22e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.576119:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef22e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.576124:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef22e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.576135:0:9317:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837712.576802:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da000/0x57f6d4e926aef227 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.576817:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da000/0x57f6d4e926aef227 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.576823:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da000/0x57f6d4e926aef227 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.576828:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837712.576832:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da000/0x57f6d4e926aef227 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.576839:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da000/0x57f6d4e926aef227 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.577038:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff889ae0332a00) 00010000:00010000:2.0:1788837712.577040:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788837712.577045:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da000/0x57f6d4e926aef227 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.577051:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da000/0x57f6d4e926aef227 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.577077:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aef219 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.577084:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aef219 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.577090:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aef219 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.577094:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837712.577104:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aef219 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.577110:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aef219 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.577243:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837712.577250:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef22e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.577256:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6daa00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837712.577259:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef22e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.577266:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef22e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.577275:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff889ae0332a00) 00010000:00010000:0.0:1788837712.577277:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788837712.577280:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef22e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.577285:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef22e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.577295:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837712.577297:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837712.577299:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837712.577328:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889af8da5a00) 00010000:00010000:2.0:1788837712.577330:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837712.577333:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aef219 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.577339:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926aef219 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837712.577348:0:9317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d0b86be reply state 000000001849d97d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef220 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.577357:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef220 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837712.577373:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff889af8da5300) 00010000:00010000:2.0:1788837712.577375:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788837712.577378:0:9317:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837712.577590:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+18:10479:x1875732012752256:12345-192.168.201.3@tcp:36:rm.0 Request processed in 2124us (9524us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788837712.577598:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:3.0:1788837712.581464:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837712.581605:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012752512 00000100:00100000:1.0:1788837712.581615:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012752512 00000100:00100000:1.0:1788837712.581682:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:1.0:1788837712.581692:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+18:10479:x1875732012752512:12345-192.168.201.3@tcp:35:rm.0 00000100:00100000:1.0:1788837712.581952:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+19:10479:x1875732012752512:12345-192.168.201.3@tcp:35:rm.0 Request processed in 260us (495us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788837712.581960:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:3.0:1788837712.585914:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837712.586056:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012752768 00000100:00100000:0.0:1788837712.586079:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012752768 00000100:00100000:0.0:1788837712.586432:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:0.0:1788837712.586443:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+19:10479:x1875732012752768:12345-192.168.201.3@tcp:36:rm.0 00010000:00010000:0.0:1788837712.586501:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788837712.586526:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef1ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9fe expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.586548:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790000/0x57f6d4e926aef18d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9db expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.586577:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889af8da5a00) 00010000:00010000:0.0:1788837712.586595:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8e00/0x57f6d4e926aef14e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9cd expref: 17 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.586603:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8899c3351700) 00010000:00010000:0.0:1788837712.586609:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837712.586632:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef235 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.586644:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef235 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.586653:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef235 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.586665:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef23c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.586671:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef23c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.586677:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef23c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.586758:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef243 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.586766:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef243 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.586827:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef243 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837712.587089:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788837712.587103:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef243 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587110:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef243 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587126:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef243 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587131:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837712.587136:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef243 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587150:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef243 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587159:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff889af8da5600) 00010000:00010000:0.0:1788837712.587161:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788837712.587165:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef243 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587171:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef243 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587188:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef235 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587194:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef235 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587207:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef235 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587212:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837712.587215:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef235 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587222:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef235 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587230:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889af8da5500) 00010000:00010000:0.0:1788837712.587233:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837712.587235:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef235 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587242:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef235 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837712.587255:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dca57e0d reply state 00000000c3f4c4e0 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef23c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587266:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef23c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837712.587272:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff889af8da5c00) 00010000:00010000:0.0:1788837712.587274:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788837712.587277:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837712.587353:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+18:10479:x1875732012752768:12345-192.168.201.3@tcp:36:rm.0 Request processed in 911us (1447us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788837712.587361:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:1.0:1788837712.825183:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c379d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036949376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837712.825266:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837712.825657:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036949376 00000100:00100000:3.0:1788837712.825666:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036949376 00000100:00100000:3.0:1788837712.825720:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788837712.825729:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036949376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837712.825755:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788837712.825840:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036949376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837712.825847:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788837712.827960:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c379d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036949376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837712.890562:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837712.890606:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837712.890644:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837712.890683:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837712.890808:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012753024 00000100:00100000:2.0:1788837712.890818:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012753024 00000100:00100000:2.0:1788837712.890888:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012753280 00000100:00100000:2.0:1788837712.890892:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012753280 00000100:00100000:2.0:1788837712.890908:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012753152 00000100:00100000:2.0:1788837712.890911:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012753152 00000100:00100000:2.0:1788837712.890956:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 192 00000100:00100000:2.0:1788837712.890966:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012753024:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837712.890966:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012752896 00000100:00100000:0.0:1788837712.890970:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012752896 00000100:00100000:0.0:1788837712.890999:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 332 00000100:00100000:0.0:1788837712.891006:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2396:x1875732012752896:12345-192.168.201.3@tcp:400:kworker.0 00000100:00080000:3.0:1788837712.891056:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837712.891061:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837712.891295:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012753024:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 330us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837712.891304:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 192 00000100:00100000:2.0:1788837712.891324:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 193 00000100:00100000:2.0:1788837712.891332:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012753280:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837712.891504:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 194 00000100:00100000:1.0:1788837712.891523:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012753152:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837712.900584:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2396:x1875732012752896:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 9564us (9925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837712.900600:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 332 00000100:00100000:2.0:1788837712.902500:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012753280:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 11156us (11880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837712.902525:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 193 00000100:00100000:1.0:1788837712.909092:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012753152:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 17569us (18396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837712.909108:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 194 00010000:00010000:2.0:1788837713.602750:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837714.620320:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837715.387022:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837715.387047:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c379d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036949504:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788837715.387261:0:8543:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332258482820ns, next at 333258479695ns, rc = 0 00000100:00100000:0.0:1788837715.387281:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036949632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837715.387337:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837715.387562:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837715.387635:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036949632 00000100:00100000:0.0:1788837715.387643:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036949632 00000100:00100000:0.0:1788837715.387693:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036949504 00000100:00100000:0.0:1788837715.387696:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036949504 00000100:00100000:0.0:1788837715.387714:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788837715.387722:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036949632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837715.387752:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837715.387824:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036949632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837715.387832:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788837715.387849:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788837715.387854:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036949504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837715.387864:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837715.387903:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036949504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837715.387922:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1788837715.387959:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c2511180 x1875732036949632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837715.387988:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036949632:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837715.388331:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837715.388354:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c379d180 x1875732036949504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837715.388368:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c379d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036949504:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788837715.640974:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837716.667105:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837716.921132:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036949888:0@lo:400:kworker.0 00000100:00100000:2.0:1788837716.921157:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036949760:0@lo:400:kworker.0 00000100:00100000:0.0:1788837716.921270:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036950144:0@lo:400:kworker.0 00000100:00100000:1.0:1788837716.922892:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036950016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837716.923387:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837716.923456:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa737b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036950400:0@lo:400:kworker.0 00000100:00100000:3.0:1788837716.923492:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837716.925305:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036950912:0@lo:400:kworker.0 00000100:00100000:3.0:1788837716.925359:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837716.925394:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036951424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837716.925417:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837716.925477:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036950912 00000100:00100000:3.0:1788837716.925497:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036950912 00000100:00100000:3.0:1788837716.925651:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788837716.925660:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036950912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837716.925711:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036950912:12345-0@lo:400:kworker.0 Request processed in 52us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837716.925718:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788837716.925739:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036951424 00000100:00100000:3.0:1788837716.925742:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036951424 00000100:00100000:3.0:1788837716.925879:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788837716.925886:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036951424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837716.925910:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837716.928559:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837716.928626:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036950272:0@lo:400:kworker.0 00000100:00100000:2.0:1788837716.928663:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837716.928689:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036950784:0@lo:400:kworker.0 00000100:00100000:2.0:1788837716.928726:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837716.928745:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036951296:0@lo:400:kworker.0 00000100:00100000:2.0:1788837716.928766:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837716.928823:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036950784 00000100:00100000:2.0:1788837716.928831:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036950784 00000100:00100000:2.0:1788837716.928886:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036951296 00000100:00100000:2.0:1788837716.928890:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036951296 00000100:00100000:2.0:1788837716.928911:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788837716.928919:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036950784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837716.928979:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036950784:12345-0@lo:400:kworker.0 Request processed in 60us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837716.928986:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788837716.929002:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788837716.929008:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036951296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837716.929034:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036951296:12345-0@lo:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837716.929040:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1788837716.929077:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa736300 x1875732036950784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837716.929090:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036950784:0@lo:400:kworker.0 00010000:00080000:2.0:1788837716.929101:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa5ec380 x1875732036951296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837716.929109:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036951296:0@lo:400:kworker.0 00000100:00080000:2.0:1788837716.929155:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788837716.929183:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa735c00 x1875732036950912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837716.929192:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036950912:0@lo:400:kworker.0 00010000:00080000:2.0:1788837716.929203:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c1c000 x1875732036951424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837716.929220:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036951424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837716.929271:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036949888 00000100:00100000:2.0:1788837716.929275:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036949888 00000100:00100000:2.0:1788837716.929306:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036950272 00000100:00100000:2.0:1788837716.929309:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036950272 00000100:00100000:2.0:1788837716.929326:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788837716.929345:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036949888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837716.929383:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036949888:12345-0@lo:400:kworker.0 Request processed in 52us (5998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837716.929390:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788837716.929402:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788837716.929408:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036950272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837716.929434:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036950272:12345-0@lo:400:kworker.0 Request processed in 27us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837716.929441:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788837716.929590:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036950272:0@lo:400:kworker.0 00000100:00100000:2.0:1788837716.929613:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036949888:0@lo:400:kworker.0 00000100:00100000:2.0:1788837716.929641:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036949760 00000100:00100000:2.0:1788837716.929645:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036949760 00000100:00100000:2.0:1788837716.929676:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788837716.929683:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036949760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837716.929721:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036949760:12345-0@lo:400:kworker.0 Request processed in 39us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837716.929728:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788837716.929755:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036950400 00000100:00100000:2.0:1788837716.929759:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036950400 00000100:00100000:2.0:1788837716.929813:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788837716.929820:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036950400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837716.929854:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036950400:12345-0@lo:400:kworker.0 Request processed in 36us (6361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837716.929878:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788837716.929903:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036949760:0@lo:400:kworker.0 00000100:00100000:2.0:1788837716.929927:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa737b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036950400:0@lo:400:kworker.0 00000100:00100000:3.0:1788837716.932210:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036951424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837716.932233:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788837716.944205:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837716.944261:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036950656:0@lo:400:kworker.0 00000100:00100000:0.0:1788837716.944296:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837716.944330:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036950656 00000100:00100000:0.0:1788837716.944338:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036950656 00000100:00100000:0.0:1788837716.944391:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788837716.944400:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036950656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837716.944462:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036950656:12345-0@lo:400:kworker.0 Request processed in 63us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837716.944470:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:0.0:1788837716.944492:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788837716.944529:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa737800 x1875732036950656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837716.944544:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036950656:0@lo:400:kworker.0 00000100:00100000:0.0:1788837716.944552:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036951168:0@lo:400:kworker.0 00000100:00100000:0.0:1788837716.944575:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837716.944598:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036951168 00000100:00100000:0.0:1788837716.944601:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036951168 00000100:00100000:0.0:1788837716.944650:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788837716.944655:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036951168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837716.944686:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036951168:12345-0@lo:400:kworker.0 Request processed in 30us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837716.944695:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1788837716.944711:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788837716.944728:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa5ed880 x1875732036951168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837716.944737:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036951168:0@lo:400:kworker.0 00000100:00100000:0.0:1788837716.944743:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036951680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837716.944801:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837716.946133:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036950144 00000100:00100000:3.0:1788837716.946145:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036950144 00000100:00100000:3.0:1788837716.946189:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036951680 00000100:00100000:3.0:1788837716.946192:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036951680 00000100:00100000:3.0:1788837716.946209:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788837716.946216:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036950144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837716.946276:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036950144:12345-0@lo:400:kworker.0 Request processed in 60us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837716.946283:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788837716.946296:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788837716.946301:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036951680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788837716.946323:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788837716.946368:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036951680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837716.946384:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788837716.949529:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036950144:0@lo:400:kworker.0 00000100:00100000:0.0:1788837716.949559:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036951680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837716.952345:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837716.952404:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036950528:0@lo:400:kworker.0 00000100:00100000:1.0:1788837716.952451:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837716.952468:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732036951040:0@lo:400:kworker.0 00000100:00100000:1.0:1788837716.952490:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837716.952556:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036950016 00000100:00100000:2.0:1788837716.952567:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036950016 00000100:00100000:2.0:1788837716.952626:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788837716.952637:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036950016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837716.952686:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837716.952744:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036950016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837716.952751:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788837716.953617:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036951552:0@lo:400:kworker.0 00000100:00100000:1.0:1788837716.953662:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788837716.953721:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7e3ed80 x1875732036950016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837716.953803:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036951552 00000100:00100000:2.0:1788837716.953809:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036951552 00000100:00100000:2.0:1788837716.953852:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788837716.954061:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036951552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837716.954109:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036951552:12345-0@lo:400:kworker.0 Request processed in 250us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837716.954116:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788837716.954924:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036950016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837716.954965:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036950528 00000100:00100000:3.0:1788837716.954971:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036950528 00000100:00100000:3.0:1788837716.955029:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036951040 00000100:00100000:3.0:1788837716.955033:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036951040 00000100:00100000:3.0:1788837716.955058:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788837716.955065:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036950528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837716.955116:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036950528:12345-0@lo:400:kworker.0 Request processed in 52us (2674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837716.955123:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788837716.955137:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788837716.955143:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732036951040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837716.955172:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732036951040:12345-0@lo:400:kworker.0 Request processed in 30us (2682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837716.955179:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1788837716.955358:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837716.955891:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036950528:0@lo:400:kworker.0 00000100:00100000:1.0:1788837716.955906:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732036951040:0@lo:400:kworker.0 00010000:00080000:1.0:1788837716.955923:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa5eca80 x1875732036951552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837716.955932:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036951552:0@lo:400:kworker.0 00010000:00010000:3.0:1788837717.688906:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837717.947739:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837717.947767:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036951808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837717.947885:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837717.947959:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036951808 00000100:00100000:0.0:1788837717.947967:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036951808 00000100:00100000:0.0:1788837717.948021:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788837717.948031:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036951808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837717.948072:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788837717.948119:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036951808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837717.948126:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788837717.948283:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036951808:0@lo:41:osp-pre-0-1.0 00000004:00080000:1.0:1788837717.955163:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788837717.955202:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1788837717.955219:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788837717.955253:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef1a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955265:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef1a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955273:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef1a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955280:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837717.955284:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef1a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955292:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef1a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955312:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff889af8da5300) 00010000:00010000:1.0:1788837717.955316:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837717.955321:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef1a2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955349:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef1a2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955373:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef1b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955379:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef1b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955385:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef1b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955390:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837717.955393:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef1b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955398:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef1b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955407:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff889ae0332a00) 00010000:00010000:1.0:1788837717.955409:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837717.955412:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef1b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955417:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef1b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955627:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef220 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955634:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef220 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955647:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef220 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955652:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dae00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837717.955654:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef220 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955660:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef220 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955668:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x5657146a (ffff889af8da5300) 00010000:00010000:1.0:1788837717.955670:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837717.955673:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef220 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955677:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef220 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x5657146a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955693:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef23c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955699:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef23c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955703:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef23c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837717.955708:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036951936:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788837717.955708:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837717.955711:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef23c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955725:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef23c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955732:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff889af8da5c00) 00010000:00010000:1.0:1788837717.955734:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837717.955737:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef23c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837717.955742:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef23c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837717.957963:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837717.958051:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036951936 00000100:00100000:2.0:1788837717.958062:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036951936 00000100:00100000:2.0:1788837717.958146:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788837717.958157:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036951936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788837717.958209:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788837717.958250:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f7f50, atime: 0x6a9f7f50, ctime: 0x6a9f7f50, blocks: 0x0 00010000:00010000:2.0:1788837717.958258:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098dc129a/0x57f6d4e926aef24a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837717.958288:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=334s v=(0 0) 00010000:00010000:2.0:1788837717.958293:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837717.958300:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098dc129a/0x57f6d4e926aef24a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837717.958575:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098dc129a/0x57f6d4e926aef24a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837717.958587:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098dc129a/0x57f6d4e926aef24a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837717.958595:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098dc129a/0x57f6d4e926aef24a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837717.958615:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788837717.958863:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036951936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 707us (904us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788837717.958872:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788837717.958900:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788837717.958915:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837717.958922:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098dc129a/0x57f6d4e926aef24a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837717.958940:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6daa00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837717.958945:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098dc129a/0x57f6d4e926aef24a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837717.958955:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098dc129a/0x57f6d4e926aef24a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837717.958975:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098dc129a/0x57f6d4e926aef24a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837717.958983:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098dc129a/0x57f6d4e926aef24a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837717.959002:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837717.959004:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837717.959006:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788837717.959046:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8899c3c1d500/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788837717.959053:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036951936:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788837718.005650:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837718.005915:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012753408 00000100:00100000:0.0:1788837718.005927:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012753408 00000100:00100000:0.0:1788837718.005990:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 334 00000100:00100000:0.0:1788837718.006000:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012753408:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837718.006096:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012753408:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 97us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837718.006105:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 334 00000100:00100000:3.0:1788837718.011226:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837718.011269:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837718.011302:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837718.011465:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012753792 00000100:00100000:1.0:1788837718.011476:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012753792 00000100:00100000:1.0:1788837718.011556:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 85 00000100:00100000:1.0:1788837718.011569:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012753792:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837718.011707:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012753536 00000100:00100000:0.0:1788837718.011711:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012753536 00000100:00100000:0.0:1788837718.011749:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012754048 00000100:00100000:0.0:1788837718.011752:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012754048 00000100:00100000:0.0:1788837718.011797:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 201 00000100:00100000:0.0:1788837718.011805:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012753536:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837718.019265:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012753792:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 7685us (7982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837718.019281:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 85 00000100:00080000:1.0:1788837718.019646:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837718.019654:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837718.019658:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837718.022596:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 202 00000100:00100000:3.0:1788837718.022617:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012754048:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837718.022706:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012754048:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 98us (11403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837718.022715:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 202 00000100:00100000:2.0:1788837718.022878:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837718.022980:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837718.029296:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012753536:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 17477us (18066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837718.029312:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 201 00000100:00100000:0.0:1788837718.029355:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012753664 00000100:00100000:0.0:1788837718.029366:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012753664 00000100:00100000:0.0:1788837718.029420:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012753920 00000100:00100000:0.0:1788837718.029424:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012753920 00000100:00100000:0.0:1788837718.029445:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 203 00000100:00100000:0.0:1788837718.029454:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012753664:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837718.029544:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012753664:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 91us (6667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837718.029551:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 203 00000100:00100000:0.0:1788837718.029564:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 204 00000100:00100000:0.0:1788837718.029586:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012753920:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837718.029611:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012753920:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 27us (6632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837718.029618:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 204 00000100:00080000:0.0:1788837718.029646:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837718.029651:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1788837718.301270:0:13686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788837718.714811:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788837719.538908:0:13734:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd3d57720 20000000:00000080:3.0:1788837719.538947:0:13734:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8899c33d1c00 uarg=0000000000000000 20000000:01000000:3.0:1788837719.539008:0:13734:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788837719.539017:0:13734:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788837719.539022:0:13734:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788837719.540865:0:13735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788837719.541133:0:13734:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788837719.553550:0:13734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788837719.553605:0:13734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788837719.553621:0:13734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788837719.553643:0:13734:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788837719.553674:0:13734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837719.553712:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef0de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef0d7 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837719.553720:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa790600/0x57f6d4e926aef0ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef0e5 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837719.553734:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa6db800/0x57f6d4e926aef0fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef0f3 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837719.553741:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef108 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef101 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837719.553753:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef10f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9b8 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837719.553760:0:13734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926aef116 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e9bf expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837719.553770:0:13734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837719.553868:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926aef116 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e9bf expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837719.553887:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926aef116 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e9bf expref: 12 pid: 6519 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837719.553906:0:13734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1875732036952064:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837719.555254:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef10f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e9b8 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837719.555290:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef10f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e9b8 expref: 12 pid: 6518 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837719.555309:0:13734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1875732036952192:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837719.555394:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef108 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aef101 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837719.555403:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef108 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aef101 expref: 23 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837719.555413:0:13734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1875732036952320:0@lo:104: 00000100:00100000:2.0:1788837719.555490:0:13734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788837719.555536:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa6db800/0x57f6d4e926aef0fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aef0f3 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837719.555545:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889afa6db800/0x57f6d4e926aef0fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aef0f3 expref: 23 pid: 6519 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837719.555554:0:13734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1875732036952448:0@lo:104: 00010000:00010000:2.0:1788837719.555580:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa790600/0x57f6d4e926aef0ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aef0e5 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837719.555588:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889afa790600/0x57f6d4e926aef0ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aef0e5 expref: 23 pid: 6516 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837719.555596:0:13734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1875732036952576:0@lo:104: 00010000:00010000:2.0:1788837719.555620:0:13734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef0de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926aef0d7 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837719.555634:0:13734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef0de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926aef0d7 expref: 23 pid: 6519 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837719.555644:0:13734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1875732036952704:0@lo:104: 00000100:00100000:2.0:1788837719.555665:0:13734:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac1254480 going to sleep for 11 seconds 00000100:00100000:1.0:1788837719.555833:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788837719.555856:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837719.555884:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837719.555894:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837719.555904:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036952320 00000100:00100000:1.0:1788837719.555913:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036952320 00000100:00100000:1.0:1788837719.555974:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036952448 00000100:00100000:1.0:1788837719.555978:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036952448 00000100:00100000:1.0:1788837719.555990:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036952576 00000100:00100000:1.0:1788837719.555993:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036952576 00000100:00100000:1.0:1788837719.556001:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036952704 00000100:00100000:1.0:1788837719.556003:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036952704 00000100:00100000:1.0:1788837719.556016:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788837719.556036:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3564c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+6:13734:x1875732036952320:12345-0@lo:104: 00010000:00010000:1.0:1788837719.556051:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef108 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556119:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788837719.556127:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3564c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+6:13734:x1875732036952320:12345-0@lo:104: Request processed in 92us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837719.556134:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788837719.556190:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788837719.556196:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+5:13734:x1875732036952448:12345-0@lo:104: 00010000:00010000:1.0:1788837719.556204:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef0fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556242:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788837719.556247:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+5:13734:x1875732036952448:12345-0@lo:104: Request processed in 51us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837719.556254:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788837719.556266:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788837719.556272:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:13734:x1875732036952576:12345-0@lo:104: 00010000:00010000:1.0:1788837719.556279:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef0ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556325:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788837719.556330:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+4:13734:x1875732036952576:12345-0@lo:104: Request processed in 59us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837719.556336:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788837719.556349:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788837719.556355:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:13734:x1875732036952704:12345-0@lo:104: 00010000:00010000:1.0:1788837719.556362:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef0de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556389:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788837719.556393:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+3:13734:x1875732036952704:12345-0@lo:104: Request processed in 40us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837719.556398:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1788837719.556419:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788837719.556426:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef108 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556434:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17c00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837719.556439:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aef108 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556451:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aef108 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837719.556458:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aef108 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837719.556465:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788837719.556509:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef108 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556516:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837719.556540:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef108 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556548:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b17c00/0x57f6d4e926aef101 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef108 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556564:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788837719.556568:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef0fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556574:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837719.556578:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aef0fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556585:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aef0fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837719.556592:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aef0fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837719.556597:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788837719.556610:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef0fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556617:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837719.556631:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef0fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556647:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b16a00/0x57f6d4e926aef0f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef0fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556658:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837719.556661:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef0ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556666:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791400 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837719.556669:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aef0ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556676:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aef0ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837719.556682:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aef0ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837719.556688:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788837719.556702:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef0ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556708:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837719.556714:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef0ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556720:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa791400/0x57f6d4e926aef0e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef0ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556729:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837719.556738:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926aef0de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556745:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dba00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837719.556748:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926aef0de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556754:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926aef0de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837719.556760:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926aef0de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837719.556764:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788837719.556810:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef0de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556827:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837719.556834:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef0de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556840:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6dba00/0x57f6d4e926aef0d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926aef0de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.556856:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837719.556858:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837719.556860:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837719.556867:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837719.556875:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837719.556891:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036952832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837719.556935:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837719.556970:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837719.556977:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036953216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837719.556998:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837719.557044:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036952832 00000100:00100000:1.0:1788837719.557049:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036952832 00010000:00010000:1.0:1788837719.557086:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef108 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aef101 expref: 24 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837719.557111:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036953216 00000100:00100000:1.0:1788837719.557115:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036953216 00010000:00010000:1.0:1788837719.557127:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef0de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aef0d7 expref: 25 pid: 6519 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837719.557146:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788837719.557153:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+25:3651:x1875732036952832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837719.557167:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837719.557174:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef108 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aef101 expref: 25 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.557183:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef108 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aef101 expref: 25 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.557201:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837719.557231:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+25:3651:x1875732036952832:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837719.557238:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788837719.557252:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788837719.557258:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732036953216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837719.557266:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837719.557277:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef0de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aef0d7 expref: 24 pid: 6519 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.557286:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef0de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aef0d7 expref: 24 pid: 6519 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837719.557296:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837719.557317:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732036953216:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837719.557323:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788837719.557373:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036953216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837719.557382:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036952832:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837719.557702:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b17800/0x57f6d4e926aef108 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aef101 expref: 23 pid: 6518 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837719.557717:0:13734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1875732036952320:0@lo:104: 00000100:00100000:2.0:1788837719.557728:0:13734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1875732036952448:0@lo:104: 00000100:00100000:2.0:1788837719.557737:0:13734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1875732036952576:0@lo:104: 00010000:00010000:2.0:1788837719.557745:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef0de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aef0d7 expref: 22 pid: 6519 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837719.557753:0:13734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1875732036952704:0@lo:104: 00000100:00100000:0.0:1788837719.558055:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036952960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837719.558094:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837719.558139:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837719.558146:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036953088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837719.558168:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837719.558203:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036952960 00000100:00100000:0.0:1788837719.558208:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036952960 00010000:00010000:0.0:1788837719.558229:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa6db800/0x57f6d4e926aef0fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aef0f3 expref: 22 pid: 6519 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837719.558251:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036953088 00000100:00100000:0.0:1788837719.558254:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036953088 00010000:00010000:0.0:1788837719.558266:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa790600/0x57f6d4e926aef0ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aef0e5 expref: 23 pid: 6516 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837719.558279:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788837719.558286:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:3648:x1875732036952960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837719.558296:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837719.558301:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa6db800/0x57f6d4e926aef0fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aef0f3 expref: 23 pid: 6519 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.558310:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa6db800/0x57f6d4e926aef0fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aef0f3 expref: 23 pid: 6519 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.558331:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6db800/0x57f6d4e926aef0fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aef0f3 expref: 23 pid: 6519 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.558343:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837719.558374:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:3648:x1875732036952960:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837719.558382:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788837719.558396:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788837719.558403:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:3648:x1875732036953088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837719.558411:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837719.558415:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa790600/0x57f6d4e926aef0ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926aef0e5 expref: 21 pid: 6516 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.558424:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa790600/0x57f6d4e926aef0ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926aef0e5 expref: 21 pid: 6516 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.558434:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa790600/0x57f6d4e926aef0ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926aef0e5 expref: 21 pid: 6516 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.558443:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837719.558464:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:3648:x1875732036953088:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837719.558470:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788837719.558500:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036953088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837719.558508:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036952960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837719.569323:0:13734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1875732036952064:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837719.569369:0:13734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13734:1875732036952192:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837719.569432:0:13734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837719.572592:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837719.572644:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837719.572751:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012754176 00000100:00100000:0.0:1788837719.572765:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012754176 00010000:00010000:0.0:1788837719.572864:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926aef116 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e9bf expref: 13 pid: 6519 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837719.572917:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012754304 00000100:00100000:0.0:1788837719.572921:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012754304 00010000:00010000:0.0:1788837719.572935:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef10f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e9b8 expref: 14 pid: 6518 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837719.572965:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:0.0:1788837719.572977:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa737800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+14:2395:x1875732012754176:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837719.573000:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837719.573008:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926aef116 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e9bf expref: 14 pid: 6519 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573030:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926aef116 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e9bf expref: 14 pid: 6519 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573055:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926aef116 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e9bf expref: 14 pid: 6519 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573079:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837719.573159:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa737800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012754176:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 183us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837719.573192:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:0.0:1788837719.573214:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:0.0:1788837719.573222:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa737b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:2396:x1875732012754304:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837719.573231:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837719.573235:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef10f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e9b8 expref: 12 pid: 6518 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573245:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef10f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e9b8 expref: 12 pid: 6518 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573255:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b17e00/0x57f6d4e926aef10f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003e9b8 expref: 12 pid: 6518 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573268:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573278:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573298:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573307:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573314:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573323:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573337:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dae00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837719.573342:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573352:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573370:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573382:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837719.573402:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa737b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:2396:x1875732012754304:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 181us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837719.573409:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 51 00010000:00010000:0.0:1788837719.573562:0:13734:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573573:0:13734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.573580:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6dae00/0x57f6d4e926aef251 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837719.741087:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837720.505080:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837720.505131:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036953344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837720.505234:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837720.505335:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036953472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837720.505395:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837720.505439:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036953344 00000100:00100000:0.0:1788837720.505450:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036953344 00000100:00100000:0.0:1788837720.505513:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036953472 00000100:00100000:0.0:1788837720.505516:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036953472 00000100:00100000:0.0:1788837720.505537:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788837720.505546:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036953344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837720.505589:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837720.505645:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036953344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837720.505653:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788837720.505676:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788837720.505683:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036953472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837720.505694:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837720.505721:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036953472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837720.505727:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1788837720.505745:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837720.505828:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036953472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837720.505872:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036953344:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788837720.553572:0:13784:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca0c3cf50 20000000:00000080:0.0:1788837720.553601:0:13784:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff889af7620c00 uarg=0000000000000000 20000000:01000000:0.0:1788837720.553660:0:13784:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788837720.553668:0:13784:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788837720.553675:0:13784:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1788837720.555847:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788837720.556111:0:13784:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788837720.556240:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788837720.556277:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788837720.556294:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788837720.556311:0:13784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788837720.556341:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef258 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837720.556361:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef258 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837720.556389:0:13784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef258 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837720.556397:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef258 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837720.556404:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef258 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837720.556411:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef258 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837720.556419:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837720.556424:0:13784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef258 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837720.556433:0:13784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef258 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837720.556451:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef258 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837720.556459:0:13784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef258 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837720.556467:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6db400/0x57f6d4e926aef258 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837720.766693:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837721.457966:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837721.458088:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012754432 00000100:00100000:3.0:1788837721.458098:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012754432 00000100:00100000:3.0:1788837721.458155:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 335 00000100:00100000:3.0:1788837721.458165:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:6167:x1875732012754432:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837721.458181:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837721.458200:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac0030600/0x57f6d4e926aef25f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003ea0c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837721.458240:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac0030600/0x57f6d4e926aef25f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea0c expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837721.458253:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac0030600/0x57f6d4e926aef25f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea0c expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837721.458263:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0030600, rc 0) 00000100:00100000:3.0:1788837721.458330:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:6167:x1875732012754432:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 167us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837721.458338:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 335 00000100:00100000:0.0:1788837721.465584:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837721.465737:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012754560 00000100:00100000:1.0:1788837721.465748:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012754560 00000100:00100000:1.0:1788837721.465924:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 336 00000100:00100000:1.0:1788837721.465956:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:6167:x1875732012754560:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837721.466129:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:6167:x1875732012754560:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 195us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837721.466146:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 336 00000100:00100000:2.0:1788837721.471465:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837721.474894:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012754688 00000100:00100000:3.0:1788837721.474910:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012754688 00000100:00100000:3.0:1788837721.475001:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 337 00000100:00100000:3.0:1788837721.475012:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:6167:x1875732012754688:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837721.475449:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:6167:x1875732012754688:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 438us (3992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837721.475458:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 337 00000100:00100000:2.0:1788837721.495678:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837721.497682:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012754816 00000100:00100000:1.0:1788837721.497700:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012754816 00000100:00100000:1.0:1788837721.497770:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 338 00000100:00100000:1.0:1788837721.497820:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:10764:x1875732012754816:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788837721.498005:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:10764:x1875732012754816:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 186us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837721.498013:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 338 00000100:00100000:1.0:1788837721.519280:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837721.519428:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012754944 00000100:00100000:0.0:1788837721.519439:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012754944 00000100:00100000:0.0:1788837721.519609:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 339 00000100:00100000:0.0:1788837721.519623:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:10764:x1875732012754944:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788837721.519818:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:10764:x1875732012754944:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 199us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837721.519827:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 339 10000000:01000000:2.0:1788837721.528890:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788837721.528899:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ae7ed4800 from 7 10000000:01000000:2.0:1788837721.528905:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837721.528959:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837721.528971:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837721.529143:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837721.529175:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036953600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837721.529690:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837721.529865:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837721.532380:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837721.539200:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036953600 00000100:00100000:0.0:1788837721.539226:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036953600 00000100:00100000:0.0:1788837721.539291:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012755072 00000100:00100000:0.0:1788837721.539295:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012755072 00000100:00100000:0.0:1788837721.539313:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788837721.539321:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:6521:x1875732036953600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837721.539337:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837721.539359:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa790000/0x57f6d4e926aef26d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef266 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837721.539392:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa790000/0x57f6d4e926aef26d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef266 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837721.539405:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa790000/0x57f6d4e926aef26d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef266 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837721.539414:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790000, rc 0) 00000100:00100000:0.0:1788837721.539726:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036953600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (9818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837721.539735:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788837721.539817:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 341 00000100:00100000:0.0:1788837721.539826:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:6167:x1875732012755072:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837721.539834:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837721.539843:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa790e00/0x57f6d4e926aef274 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003ea13 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837721.539859:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa790e00/0x57f6d4e926aef274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea13 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837721.539881:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa790e00/0x57f6d4e926aef274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea13 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837721.539889:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790e00, rc 0) 00000100:00100000:0.0:1788837721.539933:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:6167:x1875732012755072:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 108us (7567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837721.539941:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 341 00000100:00100000:2.0:1788837721.540187:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036953600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837721.540206:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef26d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837721.540226:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef26d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837721.540312:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036953728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837721.540348:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837721.540385:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837721.541483:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036953728 00000100:00100000:0.0:1788837721.541493:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036953728 00000100:00100000:0.0:1788837721.541542:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788837721.541552:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036953728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837721.541720:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036953728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837721.541728:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788837721.542143:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036953728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837721.542192:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036953856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837721.542396:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837721.542435:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837721.542726:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036953856 00000100:00100000:1.0:1788837721.542732:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036953856 00000100:00100000:1.0:1788837721.542760:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788837721.542768:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036953856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837721.542920:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036953856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837721.542927:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788837721.543457:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036953856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837721.544919:0:13797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13797:1875732036953984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837721.545183:0:13797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837721.545367:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036953984 00000100:00100000:1.0:1788837721.545375:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036953984 00000100:00100000:1.0:1788837721.545421:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788837721.545431:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:13797:x1875732036953984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837721.545728:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:13797:x1875732036953984:12345-0@lo:502:llog_process_th.0 Request processed in 299us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837721.545736:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788837721.545831:0:13797:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788837721.545852:0:13797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13797:1875732036953984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837721.545888:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837721.545899:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837721.545901:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788837721.545908:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ae7ed4800 00000020:00000080:2.0:1788837721.545911:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788837721.545973:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837721.545977:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837721.545978:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788837721.545981:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837721.547975:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837721.547978:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788837721.548104:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ae7ed4800 00000020:00000080:2.0:1788837721.548107:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788837721.548189:0:13797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13797:1875732036954112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837721.549197:0:13797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837721.552190:0:13797:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837721.552358:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036954112 00000100:00100000:1.0:1788837721.552371:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036954112 00000100:00100000:1.0:1788837721.552438:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788837721.552447:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:13797:x1875732036954112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837721.552649:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:13797:x1875732036954112:12345-0@lo:502:llog_process_th.0 Request processed in 202us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837721.552658:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788837721.554152:0:13797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13797:1875732036954112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837721.554204:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837721.554214:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837721.554216:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788837721.554227:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000100:00100000:3.0:1788837721.555661:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837721.557165:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012755200 00000100:00100000:1.0:1788837721.557179:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012755200 00000100:00100000:1.0:1788837721.557249:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 346 00000100:00100000:1.0:1788837721.557260:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:6167:x1875732012755200:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837721.557442:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:6167:x1875732012755200:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 184us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837721.557463:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 346 00000020:01000000:3.0:1788837721.559641:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788837721.559682:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837721.559694:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef26d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837721.559708:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef26d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837721.559720:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837721.559723:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889afa550800 from 7 10000000:01000000:3.0:1788837721.559726:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837721.559768:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837721.559817:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837721.559828:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837721.559856:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036954240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837721.560322:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837721.560461:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036954240 00000100:00100000:2.0:1788837721.560468:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036954240 00000100:00100000:2.0:1788837721.560526:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788837721.560535:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:6521:x1875732036954240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837721.560548:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837721.560562:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6da000/0x57f6d4e926aef282 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef27b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837721.560586:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6da000/0x57f6d4e926aef282 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef27b expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837721.560596:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6da000/0x57f6d4e926aef282 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef27b expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837721.560605:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6da000, rc 0) 00000100:00100000:2.0:1788837721.560641:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036954240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837721.560648:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788837721.566260:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837721.566384:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012755328 00000100:00100000:3.0:1788837721.566395:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012755328 00000100:00100000:3.0:1788837721.566457:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 348 00000100:00100000:3.0:1788837721.566479:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:6167:x1875732012755328:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837721.566629:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:6167:x1875732012755328:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 152us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837721.566637:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 348 00000100:00100000:0.0:1788837721.573127:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837721.573359:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012755456 00000100:00100000:3.0:1788837721.573371:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012755456 00000100:00100000:3.0:1788837721.573434:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 349 00000100:00100000:3.0:1788837721.573445:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:10767:x1875732012755456:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837721.573675:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:10767:x1875732012755456:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 232us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837721.573684:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 349 00000100:00100000:1.0:1788837721.575346:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24fa900 going to sleep for 11 seconds 00000100:00100000:1.0:1788837721.575387:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036954240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837721.575413:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef282 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837721.575426:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef282 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837721.576617:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036954368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837721.576876:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837721.576956:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac245ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837721.587115:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036954368 00000100:00100000:0.0:1788837721.587135:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036954368 00000100:00100000:0.0:1788837721.587200:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788837721.588944:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036954368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837721.589176:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036954368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (12300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837721.589252:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036954368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837721.589307:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036954496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837721.589360:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837721.589397:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837721.598095:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788837721.598154:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036954496 00000100:00100000:0.0:1788837721.598163:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036954496 00000100:00100000:0.0:1788837721.598202:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788837721.598224:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036954496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837721.598401:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036954496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (9041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837721.598408:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788837721.599132:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036954496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837721.600584:0:13801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13801:1875732036954624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837721.601332:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837721.601379:0:13801:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac245ad80 going to sleep for 11 seconds 00000040:00080000:0.0:1788837721.601538:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788837721.601632:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036954624 00000100:00100000:0.0:1788837721.601640:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036954624 00000100:00100000:0.0:1788837721.601705:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788837721.601715:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:13801:x1875732036954624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837721.601898:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:13801:x1875732036954624:12345-0@lo:502:llog_process_th.0 Request processed in 184us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837721.601906:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788837721.603704:0:13801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13801:1875732036954624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788837721.603769:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837721.603807:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837721.603810:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788837721.603818:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889afa550800 00000020:00000080:1.0:1788837721.603821:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788837721.603889:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837721.603902:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837721.603903:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788837721.603906:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837721.603909:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837721.603910:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788837721.603913:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889afa550800 00000020:00000080:1.0:1788837721.603915:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788837721.603962:0:13801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13801:1875732036954752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837721.604051:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837721.604084:0:13801:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adeb73300 going to sleep for 11 seconds 00000100:00100000:0.0:1788837721.606631:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036954752 00000100:00100000:0.0:1788837721.606648:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036954752 00000100:00100000:0.0:1788837721.606714:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788837721.606724:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:13801:x1875732036954752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837721.606938:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:13801:x1875732036954752:12345-0@lo:502:llog_process_th.0 Request processed in 215us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837721.606947:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788837721.607113:0:13801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13801:1875732036954752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788837721.607149:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837721.607157:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837721.607159:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788837721.607164:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788837721.608273:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788837721.608299:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837721.608309:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef282 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837721.608338:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef282 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837721.608350:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788837721.608353:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ae7d4b000 from 7 10000000:01000000:2.0:1788837721.608356:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837721.608390:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837721.608398:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837721.608408:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837721.608430:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036954880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837721.608487:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837721.608539:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788837721.608729:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036954880 00000100:00100000:0.0:1788837721.608737:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036954880 00000100:00100000:0.0:1788837721.608808:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788837721.608818:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:6521:x1875732036954880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837721.608832:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837721.608847:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa790400/0x57f6d4e926aef290 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef289 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837721.608872:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa790400/0x57f6d4e926aef290 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef289 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837721.608883:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa790400/0x57f6d4e926aef290 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef289 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837721.609578:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790400, rc 0) 00000100:00100000:0.0:1788837721.609644:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036954880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 826us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837721.609652:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788837721.609808:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036954880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837721.609827:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837721.609838:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837721.609906:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036955008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837721.609936:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837721.609978:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788837721.610070:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036955008 00000100:00100000:1.0:1788837721.610076:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036955008 00000100:00100000:1.0:1788837721.610104:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788837721.610112:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036955008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837721.610331:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036955008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837721.610338:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788837721.611118:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036955008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837721.611160:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036955136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837721.611286:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837721.611322:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788837721.611424:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036955136 00000100:00100000:0.0:1788837721.611430:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036955136 00000100:00100000:0.0:1788837721.611469:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788837721.611478:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036955136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837721.611677:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036955136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837721.611684:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788837721.612159:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837721.612254:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036955136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837721.616224:0:13802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13802:1875732036955264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837721.616307:0:13802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837721.625275:0:13802:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adf4eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837721.629931:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012755584 00000100:00100000:1.0:1788837721.629957:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012755584 00000100:00100000:1.0:1788837721.630094:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036955264 00000100:00100000:1.0:1788837721.630099:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036955264 00000100:00100000:1.0:1788837721.630124:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 357 00000100:00100000:1.0:1788837721.630134:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:10767:x1875732012755584:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788837721.630309:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788837721.630320:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:13802:x1875732036955264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837721.630383:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:10767:x1875732012755584:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 250us (18225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837721.630392:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 357 00000100:00100000:0.0:1788837721.630414:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:13802:x1875732036955264:12345-0@lo:502:llog_process_th.0 Request processed in 97us (14108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837721.630420:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788837721.630478:0:13802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13802:1875732036955264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837721.630525:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837721.630535:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837721.630537:0:13802:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788837721.630545:0:13802:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ae7d4b000 00000020:00000080:0.0:1788837721.630547:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788837721.630610:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837721.630891:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837721.630894:0:13802:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788837721.630898:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837721.630902:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837721.630904:0:13802:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788837721.630908:0:13802:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ae7d4b000 00000020:00000080:0.0:1788837721.630910:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788837721.630969:0:13802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13802:1875732036955392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837721.631016:0:13802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837721.631040:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036955392 00000100:00100000:0.0:1788837721.631044:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036955392 00000100:00100000:0.0:1788837721.631066:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788837721.631072:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:13802:x1875732036955392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837721.631133:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:13802:x1875732036955392:12345-0@lo:502:llog_process_th.0 Request processed in 60us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837721.631147:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788837721.631176:0:13802:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adf4eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837721.631190:0:13802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13802:1875732036955392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837721.631207:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837721.631225:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837721.631226:0:13802:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788837721.631230:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788837721.632372:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788837721.632418:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837721.632429:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837721.632441:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837721.632453:0:6521:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837721.632455:0:6521:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ac3ec4000 from 7 10000000:01000000:3.0:1788837721.632458:0:6521:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837721.632493:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837721.632502:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837721.633614:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837721.633640:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036955520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837721.633699:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837721.633742:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24fa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837721.634728:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036955520 00000100:00100000:1.0:1788837721.634740:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036955520 00000100:00100000:1.0:1788837721.634816:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788837721.634826:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:6521:x1875732036955520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837721.634856:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837721.634875:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c9800/0x57f6d4e926aef29e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926aef297 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837721.634906:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c9800/0x57f6d4e926aef29e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926aef297 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837721.634916:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c9800/0x57f6d4e926aef29e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926aef297 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837721.634925:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9800, rc 0) 00000100:00100000:1.0:1788837721.635006:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036955520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837721.635013:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788837721.635078:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036955520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837721.635093:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837721.635102:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837721.635323:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036955648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837721.635353:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837721.635373:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adeb73a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837721.635388:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036955648 00000100:00100000:1.0:1788837721.635392:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036955648 00000100:00100000:1.0:1788837721.635415:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788837721.635421:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036955648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837721.635630:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036955648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837721.635637:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788837721.635760:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036955648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837721.635825:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036955776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837721.635866:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837721.635890:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af8f73840 going to sleep for 11 seconds 00000100:00100000:1.0:1788837721.635943:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036955776 00000100:00100000:1.0:1788837721.635948:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036955776 00000100:00100000:1.0:1788837721.636310:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788837721.636320:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036955776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837721.636412:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:6521:x1875732036955776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837721.636459:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b603ecff-2147-4e64-a76e-e3f6861ab0fb:6521:1875732036955776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837721.636974:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13804:1875732036955904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837721.637025:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837721.637054:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24faf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837721.638161:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036955904 00000100:00100000:0.0:1788837721.638171:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036955904 00000100:00100000:1.0:1788837721.646087:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000040:00080000:2.0:1788837721.648490:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788837721.657397:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788837721.657419:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:13804:x1875732036955904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837721.659849:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:13804:x1875732036955904:12345-0@lo:502:llog_process_th.0 Request processed in 2428us (22813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837721.659864:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788837721.669912:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13804:1875732036955904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788837721.669995:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837721.670009:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837721.670011:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788837721.670017:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ac3ec4000 00000020:00000080:3.0:1788837721.670020:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788837721.670084:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837721.670087:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837721.670089:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788837721.670091:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837721.670093:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837721.670094:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788837721.670098:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ac3ec4000 00000020:00000080:3.0:1788837721.670100:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788837721.670148:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13804:1875732036956032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837721.670729:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837721.670812:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24faf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837721.670878:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036956032 00000100:00100000:0.0:1788837721.670885:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036956032 00000100:00100000:0.0:1788837721.670942:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788837721.670953:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:13804:x1875732036956032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837721.671098:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:13804:x1875732036956032:12345-0@lo:502:llog_process_th.0 Request processed in 146us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837721.671113:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788837721.672892:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b603ecff-2147-4e64-a76e-e3f6861ab0fb:13804:1875732036956032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788837721.672966:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837721.672976:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837721.672979:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788837721.672991:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788837721.673826:0:6521:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788837721.673862:0:6521:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788837721.673874:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837721.673887:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837721.785009:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837722.042096:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036956160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837722.042211:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837722.042293:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036956160 00000100:00100000:1.0:1788837722.042300:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036956160 00000100:00100000:1.0:1788837722.042348:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788837722.042356:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036956160:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837722.042557:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036956416:0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.042590:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837722.042610:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036956928:0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.042633:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837722.042650:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036957440:0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.042688:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837722.042714:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788837722.042720:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036956288:0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.042758:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837722.042812:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036956800:0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.042853:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837722.042888:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036957312:0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.042929:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837722.042980:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036956928 00000100:00100000:2.0:1788837722.042984:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036956928 00000100:00100000:2.0:1788837722.043054:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036957440 00000100:00100000:2.0:1788837722.043060:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036957440 00000100:00100000:2.0:1788837722.043105:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788837722.043113:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036956928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.043197:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036956928:12345-0@lo:400:kworker.0 Request processed in 82us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837722.043206:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788837722.043232:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788837722.043244:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036957440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.043298:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036957440:12345-0@lo:400:kworker.0 Request processed in 57us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837722.043308:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788837722.043392:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036956928:0@lo:400:kworker.0 00010000:00080000:2.0:1788837722.043414:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa7aed80 x1875732036957440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837722.043426:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036957440:0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.043548:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837722.043560:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036957824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837722.043598:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837722.043655:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036956416 00000100:00100000:2.0:1788837722.043662:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036956416 00000100:00100000:2.0:1788837722.043694:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788837722.043704:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036956416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.043763:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036956416:12345-0@lo:400:kworker.0 Request processed in 60us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837722.043822:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788837722.043867:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036956416:0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.043935:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036957824 00000100:00100000:2.0:1788837722.043941:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036957824 00000100:00100000:2.0:1788837722.043981:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788837722.043992:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036957824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837722.044019:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837722.044077:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036957824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837722.044084:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1788837722.044101:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837722.044106:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837722.044115:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036956288 00000100:00100000:2.0:1788837722.044119:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036956288 00000100:00100000:2.0:1788837722.044151:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036956800 00000100:00100000:2.0:1788837722.044157:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036956800 00000100:00100000:2.0:1788837722.044183:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036957312 00000100:00100000:2.0:1788837722.044187:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036957312 00000100:00100000:2.0:1788837722.044212:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788837722.044221:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036956288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.044274:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036956288:12345-0@lo:400:kworker.0 Request processed in 53us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837722.044283:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788837722.044302:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788837722.044312:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036956800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.044357:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036956800:12345-0@lo:400:kworker.0 Request processed in 46us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837722.044365:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788837722.044382:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788837722.044391:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036957312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.044470:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036957312:12345-0@lo:400:kworker.0 Request processed in 79us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837722.044479:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:2.0:1788837722.044517:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788837722.044546:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac618ca80 x1875732036957824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837722.044567:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036957824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837722.044586:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036956288:0@lo:400:kworker.0 00010000:00080000:2.0:1788837722.044601:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa735180 x1875732036956800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837722.044611:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036956800:0@lo:400:kworker.0 00010000:00080000:2.0:1788837722.044626:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa7afb80 x1875732036957312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837722.044635:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036957312:0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.044728:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036956672:0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.044811:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837722.044845:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036957184:0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.044882:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837722.044909:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036957696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837722.044943:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837722.044973:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788837722.044983:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036956544:0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.045015:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837722.045058:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036957056:0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.045096:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837722.045114:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036957568:0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.045140:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837722.045192:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036957056 00000100:00100000:2.0:1788837722.045200:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036957056 00000100:00100000:2.0:1788837722.045239:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036957568 00000100:00100000:2.0:1788837722.045244:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036957568 00000100:00100000:2.0:1788837722.045269:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788837722.045279:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af76ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875732036957056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.045338:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af76ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875732036957056:12345-0@lo:400:kworker.0 Request processed in 60us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837722.045346:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788837722.045569:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788837722.045580:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036957568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837722.045626:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036957568:12345-0@lo:400:kworker.0 Request processed in 48us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837722.045633:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788837722.045664:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036956672 00000100:00100000:2.0:1788837722.045671:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036956672 00000100:00100000:2.0:1788837722.045706:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036957184 00000100:00100000:2.0:1788837722.045711:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036957184 00000100:00100000:2.0:1788837722.045732:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036956544 00000100:00100000:2.0:1788837722.045737:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036956544 00000100:00100000:2.0:1788837722.045760:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788837722.045769:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036956672:12345-0@lo:400:kworker.0 00000004:00000024:1.0:1788837722.045853:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788837722.045895:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036956160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3538us (3684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837722.045902:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788837722.045963:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788837722.045972:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036957184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837722.046001:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036957184:12345-0@lo:400:kworker.0 Request processed in 32us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837722.046007:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788837722.046018:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788837722.046024:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036956544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837722.046050:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036956544:12345-0@lo:400:kworker.0 Request processed in 26us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837722.046055:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788837722.046071:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036957696 00000100:00100000:1.0:1788837722.046074:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036957696 00000100:00100000:1.0:1788837722.046096:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788837722.046102:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036957696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837722.046116:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788837722.046120:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837722.046125:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837722.046127:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837722.046143:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036957696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837722.046161:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788837722.046161:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036956544:0@lo:400:kworker.0 00000100:00100000:0.0:1788837722.046174:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036957056:0@lo:400:kworker.0 00010000:00080000:0.0:1788837722.046186:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa7af100 x1875732036957568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837722.046196:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036957568:0@lo:400:kworker.0 00000100:00100000:0.0:1788837722.046221:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036957184:0@lo:400:kworker.0 00010000:00080000:0.0:1788837722.046230:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac618df80 x1875732036957696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837722.046244:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036957696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837722.046256:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036956160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837722.049101:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036956672:12345-0@lo:400:kworker.0 Request processed in 3330us (4328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837722.049130:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788837722.049322:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036956672:0@lo:400:kworker.0 00000040:00080000:0.0:1788837722.619185:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788837722.682263:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788837722.812516:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837723.065312:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837723.065344:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036957952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837723.065443:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837723.065808:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036957952 00000100:00100000:0.0:1788837723.065818:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036957952 00000100:00100000:0.0:1788837723.065876:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788837723.065886:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036957952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837723.065922:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788837723.065994:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036957952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837723.066017:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788837723.066166:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036957952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837723.126802:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837723.126856:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837723.126889:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837723.126918:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837723.126937:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837723.126973:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837723.127154:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012755968 00000100:00100000:3.0:1788837723.127165:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012755968 00000100:00100000:3.0:1788837723.127226:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012756224 00000100:00100000:3.0:1788837723.127229:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012756224 00000100:00100000:3.0:1788837723.127256:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012755840 00000100:00100000:3.0:1788837723.127259:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012755840 00000100:00100000:3.0:1788837723.127276:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012756352 00000100:00100000:3.0:1788837723.127278:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012756352 00000100:00100000:3.0:1788837723.127298:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 211 00000100:00100000:3.0:1788837723.127308:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012755968:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837723.127381:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012755968:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 75us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837723.127388:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 211 00000100:00100000:3.0:1788837723.127403:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 212 00000100:00100000:3.0:1788837723.127408:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012756224:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837723.127430:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012756224:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 22us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837723.127435:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 212 00000100:00100000:3.0:1788837723.127444:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 213 00000100:00100000:3.0:1788837723.127449:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012755840:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837723.127466:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012755840:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 18us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837723.127487:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 213 00000100:00100000:3.0:1788837723.127497:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 214 00000100:00100000:3.0:1788837723.127502:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012756352:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837723.127522:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012756352:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 20us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837723.127527:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 214 00000100:00100000:2.0:1788837723.127697:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012756096 00000100:00100000:2.0:1788837723.127701:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012756096 00000100:00100000:2.0:1788837723.127740:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 90 00000100:00100000:2.0:1788837723.127747:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012756096:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837723.127809:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012756096:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 62us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837723.127815:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 90 00000100:00080000:0.0:1788837723.128018:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837723.128023:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837723.128025:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837723.128465:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012755712 00000100:00100000:1.0:1788837723.128471:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012755712 00000100:00100000:1.0:1788837723.128515:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 365 00000100:00100000:1.0:1788837723.128523:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012755712:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837723.128574:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012755712:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 51us (1819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837723.128580:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 365 00010000:00010000:3.0:1788837723.832987:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788837724.102975:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:2.0:1788837724.857278:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837725.628706:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837725.628758:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036958080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837725.628849:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837725.629102:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837725.629113:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036958208:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837725.629149:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837725.629174:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036958080 00000100:00100000:2.0:1788837725.629182:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036958080 00000100:00100000:2.0:1788837725.629234:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036958208 00000100:00100000:2.0:1788837725.629237:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036958208 00000100:00100000:2.0:1788837725.629254:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788837725.629262:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036958080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837725.629290:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837725.629348:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036958080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837725.629356:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788837725.629372:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788837725.629378:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036958208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837725.629387:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837725.629402:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788837725.629408:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8899c3c1d500, transno 4294967301 00000100:00100000:2.0:1788837725.629416:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036958208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837725.629421:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788837725.629423:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036958080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837725.629464:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036958208:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788837725.629522:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837725.881090:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837726.904940:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837727.161548:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837727.161573:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036958336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837727.161650:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837727.161727:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036958336 00000100:00100000:1.0:1788837727.161735:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036958336 00000100:00100000:1.0:1788837727.161810:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788837727.161819:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036958336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788837727.161853:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788837727.161913:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036958336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837727.161921:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788837727.161967:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036958336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837727.164217:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837727.164239:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036958464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837727.164307:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837727.164373:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036958464 00000100:00100000:0.0:1788837727.164380:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036958464 00000100:00100000:0.0:1788837727.164435:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788837727.164445:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036958464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837727.164478:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837727.164526:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036958464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837727.164533:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1788837727.164562:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788837727.164606:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa735f80 x1875732036958464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837727.164625:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036958464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837727.164864:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732036958976:0@lo:400:kworker.0 00000100:00100000:3.0:1788837727.164910:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837727.164931:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c379d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036959488:0@lo:400:kworker.0 00000100:00100000:3.0:1788837727.164954:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837727.164972:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788837727.164977:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036958848:0@lo:400:kworker.0 00000100:00100000:3.0:1788837727.165001:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837727.165020:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c379ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036959360:0@lo:400:kworker.0 00000100:00100000:3.0:1788837727.165040:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837727.165053:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036959872:0@lo:400:kworker.0 00000100:00100000:3.0:1788837727.165082:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837727.165111:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036958848 00000100:00100000:3.0:1788837727.165115:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036958848 00000100:00100000:3.0:1788837727.165144:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788837727.165151:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036958848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837727.165202:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036958848:12345-0@lo:400:kworker.0 Request processed in 50us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837727.165209:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788837727.165235:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036958848:0@lo:400:kworker.0 00000100:00100000:3.0:1788837727.165256:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036958976 00000100:00100000:3.0:1788837727.165260:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036958976 00000100:00100000:3.0:1788837727.165283:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788837727.165290:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732036958976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837727.165322:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875732036958976:12345-0@lo:400:kworker.0 Request processed in 32us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837727.165328:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788837727.165350:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875732036958976:0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.165542:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036958592:0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.165576:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837727.165608:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036959104:0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.165631:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837727.165649:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036959616:0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.165671:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837727.165698:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788837727.165705:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036958720:0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.165728:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837727.165744:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036959232:0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.165765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837727.165799:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036959744:0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.165822:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837727.165844:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036959104 00000100:00100000:0.0:1788837727.165848:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036959104 00000100:00100000:0.0:1788837727.165874:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036959616 00000100:00100000:0.0:1788837727.165877:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036959616 00000100:00100000:0.0:1788837727.165905:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036958720 00000100:00100000:0.0:1788837727.165908:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036958720 00000100:00100000:0.0:1788837727.165917:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036959232 00000100:00100000:0.0:1788837727.165919:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036959232 00000100:00100000:0.0:1788837727.165930:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036959744 00000100:00100000:0.0:1788837727.165932:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036959744 00000100:00100000:0.0:1788837727.165944:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788837727.165959:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036959104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.165996:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036959104:12345-0@lo:400:kworker.0 Request processed in 38us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837727.166003:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788837727.166016:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788837727.166021:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036959616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.166046:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036959616:12345-0@lo:400:kworker.0 Request processed in 25us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837727.166052:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788837727.166172:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788837727.166179:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036958720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.166207:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036958720:12345-0@lo:400:kworker.0 Request processed in 30us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837727.166214:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788837727.166225:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788837727.166231:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036959232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.166256:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036959232:12345-0@lo:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837727.166262:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788837727.166273:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788837727.166278:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036959744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.166301:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036959744:12345-0@lo:400:kworker.0 Request processed in 23us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837727.166306:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:0.0:1788837727.166321:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788837727.166331:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837727.166353:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036958720:0@lo:400:kworker.0 00010000:00080000:0.0:1788837727.166365:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c1f100 x1875732036959232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837727.166374:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036959232:0@lo:400:kworker.0 00010000:00080000:0.0:1788837727.166383:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27bea00 x1875732036959744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837727.166391:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036959744:0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.166400:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036959104:0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.166408:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036959616:0@lo:400:kworker.0 00000100:00100000:2.0:1788837727.166498:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036959488 00000100:00100000:2.0:1788837727.166503:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036959488 00000100:00100000:2.0:1788837727.166544:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036959360 00000100:00100000:2.0:1788837727.166548:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036959360 00000100:00100000:2.0:1788837727.166561:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036959872 00000100:00100000:2.0:1788837727.166564:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036959872 00000100:00100000:2.0:1788837727.166577:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788837727.166584:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036959488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837727.166621:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036959488:12345-0@lo:400:kworker.0 Request processed in 38us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837727.166628:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788837727.166640:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788837727.166646:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036959360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837727.166673:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036959360:12345-0@lo:400:kworker.0 Request processed in 28us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837727.166678:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788837727.166700:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788837727.166706:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036959872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837727.166733:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036959872:12345-0@lo:400:kworker.0 Request processed in 27us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837727.166739:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1788837727.166985:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837727.166989:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837727.170200:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837727.170232:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036960000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837727.170305:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837727.171005:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036958592 00000100:00100000:3.0:1788837727.171016:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036958592 00000100:00100000:3.0:1788837727.171086:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788837727.171096:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036958592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837727.171175:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036958592:12345-0@lo:400:kworker.0 Request processed in 80us (5597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837727.171182:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788837727.171245:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c379ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036959360:0@lo:400:kworker.0 00010000:00080000:3.0:1788837727.171261:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27bc700 x1875732036959872/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837727.171270:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036959872:0@lo:400:kworker.0 00000100:00100000:3.0:1788837727.171281:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c379d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036959488:0@lo:400:kworker.0 00000100:00100000:2.0:1788837727.171447:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036958592:0@lo:400:kworker.0 00000100:00100000:0.0:1788837727.172344:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036960000 00000100:00100000:0.0:1788837727.172353:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036960000 00000100:00100000:0.0:1788837727.172403:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788837727.172411:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa736300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036960000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788837727.172442:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837727.172506:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa736300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036960000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (2201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837727.172512:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1788837727.172593:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7d42300 x1875732036960000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837727.172610:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036960000:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788837727.929021:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837728.185189:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c337c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036960128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837728.185267:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837728.185550:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036960128 00000100:00100000:0.0:1788837728.185558:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036960128 00000100:00100000:0.0:1788837728.185652:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788837728.185662:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036960128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837728.185706:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788837728.185800:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036960128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837728.185807:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788837728.185892:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c337c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036960128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837728.246896:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837728.246938:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837728.246973:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837728.247003:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837728.247028:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837728.247054:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837728.247128:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012756480 00000100:00100000:3.0:1788837728.247132:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012756736 00000100:00100000:3.0:1788837728.247140:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012756736 00000100:00100000:1.0:1788837728.247140:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012756480 00000100:00100000:3.0:1788837728.247196:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012756992 00000100:00100000:3.0:1788837728.247200:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012756992 00000100:00100000:1.0:1788837728.247205:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 367 00000100:00100000:1.0:1788837728.247219:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012756480:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837728.247222:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012756608 00000100:00100000:3.0:1788837728.247227:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012756608 00000100:00100000:3.0:1788837728.247241:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012757120 00000100:00100000:3.0:1788837728.247243:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012757120 00000100:00100000:3.0:1788837728.247257:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 221 00000100:00100000:3.0:1788837728.247266:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012756736:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837728.247301:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012756480:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 84us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837728.247308:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012756736:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 41us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837728.247315:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 367 00000100:00100000:3.0:1788837728.247321:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 221 00000100:00100000:3.0:1788837728.247339:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 222 00000100:00100000:3.0:1788837728.247347:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012756992:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837728.247362:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 223 00000100:00100000:3.0:1788837728.247376:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012756992:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837728.247376:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012756608:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837728.247388:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 222 00000100:00100000:3.0:1788837728.247402:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 224 00000100:00100000:1.0:1788837728.247411:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012756608:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 40us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837728.247420:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 223 00000100:00100000:3.0:1788837728.247424:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012757120:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837728.247451:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012757120:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 42us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837728.247458:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 224 00000100:00080000:0.0:1788837728.248542:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837728.248553:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837728.249150:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012756864 00000100:00100000:2.0:1788837728.249161:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012756864 00000100:00100000:2.0:1788837728.249239:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 94 00000100:00100000:2.0:1788837728.249249:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012756864:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837728.249323:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012756864:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 75us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837728.249330:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 94 00000100:00080000:0.0:1788837728.249516:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837728.953094:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837729.979155:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837730.746038:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036960256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837730.746113:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837730.746286:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036960256 00000100:00100000:2.0:1788837730.746295:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036960256 00000100:00100000:2.0:1788837730.746367:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788837730.746377:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036960256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837730.746408:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837730.746457:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036960256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837730.746463:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788837730.746556:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036960256:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788837730.746630:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837730.746759:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837730.746802:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036960384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837730.746836:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837730.746966:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036960384 00000100:00100000:1.0:1788837730.746971:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036960384 00000100:00100000:1.0:1788837730.747027:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788837730.747034:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036960384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788837730.747045:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837730.747075:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036960384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837730.747082:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1788837730.747140:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837730.747164:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036960384:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788837731.001661:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837732.025133:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837732.281148:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036960512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837732.281239:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837732.281369:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036960512 00000100:00100000:1.0:1788837732.281379:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036960512 00000100:00100000:1.0:1788837732.281426:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788837732.281435:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036960512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788837732.281470:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788837732.281484:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c379d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036960896:0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.281512:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036960512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837732.281519:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788837732.281538:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837732.281542:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036960768:0@lo:400:kworker.0 00000100:00100000:3.0:1788837732.281571:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036961408:0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.281571:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837732.281587:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732036961280:0@lo:400:kworker.0 00000100:00100000:3.0:1788837732.281624:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837732.281636:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837732.281642:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036961920:0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.281650:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732036961792:0@lo:400:kworker.0 00000100:00100000:3.0:1788837732.281662:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837732.281668:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837732.281685:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788837732.281691:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c379ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036961024:0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.281695:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788837732.281700:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036960640:0@lo:400:kworker.0 00000100:00100000:3.0:1788837732.281712:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837732.281727:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036961536:0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.281734:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837732.281745:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837732.281754:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036961152:0@lo:400:kworker.0 00000100:00100000:3.0:1788837732.281756:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036962048:0@lo:400:kworker.0 00000100:00100000:3.0:1788837732.281772:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837732.281772:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837732.281811:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036961664:0@lo:400:kworker.0 00000100:00100000:3.0:1788837732.281813:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036961408 00000100:00100000:3.0:1788837732.281816:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036961408 00000100:00100000:1.0:1788837732.281832:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837732.281845:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036961920 00000100:00100000:3.0:1788837732.281848:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036961920 00000100:00100000:1.0:1788837732.281850:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036960768 00000100:00100000:1.0:1788837732.281852:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036960768 00000100:00100000:3.0:1788837732.281859:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036961536 00000100:00100000:3.0:1788837732.281861:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036961536 00000100:00100000:1.0:1788837732.281869:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036961280 00000100:00100000:3.0:1788837732.281872:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036962048 00000100:00100000:1.0:1788837732.281872:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036961280 00000100:00100000:3.0:1788837732.281874:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036962048 00000100:00100000:1.0:1788837732.281883:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036961792 00000100:00100000:3.0:1788837732.281885:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788837732.281885:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036961792 00000100:00100000:3.0:1788837732.281890:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036961408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.281896:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036961024 00000100:00100000:1.0:1788837732.281897:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036961024 00000100:00100000:1.0:1788837732.281906:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036961152 00000100:00100000:1.0:1788837732.281908:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036961152 00000100:00100000:1.0:1788837732.281919:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036961664 00000100:00100000:1.0:1788837732.281921:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036961664 00000100:00100000:1.0:1788837732.281935:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788837732.281941:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036961408:12345-0@lo:400:kworker.0 Request processed in 50us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837732.281941:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036960768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837732.281947:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788837732.281959:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788837732.281964:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036961920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.281974:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036960768:12345-0@lo:400:kworker.0 Request processed in 34us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837732.281981:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788837732.281988:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036961920:12345-0@lo:400:kworker.0 Request processed in 25us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837732.281993:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788837732.281999:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732036961280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837732.282000:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788837732.282024:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732036961280:12345-0@lo:400:kworker.0 Request processed in 25us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837732.282029:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788837732.282038:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788837732.282044:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732036961792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837732.282055:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788837732.282061:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036961536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.282068:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732036961792:12345-0@lo:400:kworker.0 Request processed in 24us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837732.282081:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788837732.282093:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788837732.282099:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036961024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837732.282280:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788837732.282290:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036961152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837732.282384:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036962176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837732.283303:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036961024:12345-0@lo:400:kworker.0 Request processed in 1199us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837732.283311:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788837732.283337:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788837732.283346:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036961664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.283390:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036961664:12345-0@lo:400:kworker.0 Request processed in 48us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837732.283396:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788837732.283423:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788837732.283431:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036962048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.283464:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036962048:12345-0@lo:400:kworker.0 Request processed in 35us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837732.283470:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788837732.283501:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036960640 00000100:00100000:1.0:1788837732.283507:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036960640 00000100:00100000:1.0:1788837732.283541:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788837732.283548:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036960640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.283579:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036960640:12345-0@lo:400:kworker.0 Request processed in 32us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837732.283586:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788837732.283660:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036962304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837732.283725:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837732.283763:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036960640:0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.283797:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036961664:0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.283813:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa7ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036960768:0@lo:400:kworker.0 00010000:00080000:1.0:1788837732.283827:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c1ca80 x1875732036961280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837732.283837:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732036961280:0@lo:400:kworker.0 00010000:00080000:1.0:1788837732.283848:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c1ce00 x1875732036961792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837732.283857:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732036961792:0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.283896:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036962304 00000100:00100000:1.0:1788837732.283900:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036962304 00000100:00100000:1.0:1788837732.283930:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788837732.283937:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036962304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788837732.283957:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837732.283994:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036962304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837732.284000:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:1.0:1788837732.284024:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c35d5180 x1875732036962304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837732.284039:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036962304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837732.284076:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036960896 00000100:00100000:1.0:1788837732.284080:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036960896 00000100:00100000:1.0:1788837732.284114:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788837732.284120:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036960896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.284156:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036960896:12345-0@lo:400:kworker.0 Request processed in 36us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837732.284162:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1788837732.284340:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837732.284347:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837732.284350:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837732.284352:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837732.284386:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036960512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837732.284421:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c379ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036961024:0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.284434:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036961536:0@lo:400:kworker.0 00010000:00080000:1.0:1788837732.284448:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3344700 x1875732036962048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837732.284457:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036962048:0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.284469:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c379d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036960896:0@lo:400:kworker.0 00000100:00100000:1.0:1788837732.284481:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036961408:0@lo:400:kworker.0 00010000:00080000:1.0:1788837732.284491:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3346300 x1875732036961920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837732.284499:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036961920:0@lo:400:kworker.0 00000100:00100000:2.0:1788837732.288954:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036961152:12345-0@lo:400:kworker.0 Request processed in 6654us (7168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837732.288985:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788837732.289082:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036961152:0@lo:400:kworker.0 00000100:00100000:3.0:1788837732.293801:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036961536:12345-0@lo:400:kworker.0 Request processed in 11704us (12019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837732.293816:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788837732.298463:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837732.300480:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036962176 00000100:00100000:1.0:1788837732.300495:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036962176 00000100:00100000:1.0:1788837732.300570:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788837732.300579:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036962176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837732.300634:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837732.300705:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036962176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837732.300712:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:0.0:1788837732.300869:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa736680 x1875732036962176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837732.300890:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036962176:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788837732.861275:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788837732.921681:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788837733.049620:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837733.306798:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837733.306824:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036962432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837733.306903:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837733.307257:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036962432 00000100:00100000:3.0:1788837733.307267:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036962432 00000100:00100000:3.0:1788837733.307324:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788837733.307333:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036962432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837733.307369:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788837733.307429:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036962432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837733.307436:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788837733.307567:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036962432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837733.365134:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837733.365176:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837733.365216:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837733.365301:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012757248 00000100:00100000:1.0:1788837733.365312:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012757248 00000100:00100000:1.0:1788837733.365383:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 369 00000100:00100000:1.0:1788837733.365393:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012757248:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837733.365466:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012757248:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 74us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837733.365473:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 369 00000100:00100000:2.0:1788837733.365677:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012757504 00000100:00100000:2.0:1788837733.365682:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012757504 00000100:00100000:2.0:1788837733.365732:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012757376 00000100:00100000:2.0:1788837733.365736:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012757376 00000100:00100000:2.0:1788837733.365759:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 231 00000100:00100000:2.0:1788837733.365766:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012757504:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837733.365850:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012757504:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 83us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837733.365857:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 231 00000100:00100000:2.0:1788837733.365872:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 232 00000100:00100000:2.0:1788837733.365878:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012757376:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837733.365905:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012757376:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 27us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837733.365912:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 232 00000100:00080000:1.0:1788837733.366264:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837733.366269:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788837733.371302:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837733.371419:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012757632 00000100:00100000:1.0:1788837733.371431:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012757632 00000100:00100000:1.0:1788837733.371518:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:1.0:1788837733.371531:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+5:2392:x1875732012757632:12345-192.168.201.3@tcp:9:kworker.0 00000020:00000080:1.0:1788837733.371588:0:8441:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aef1c5 00000100:00080000:1.0:1788837733.371598:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8899c3640800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837733.371664:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:3.0:1788837733.371878:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788837733.371998:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837733.372155:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+2:2392:x1875732012757632:12345-192.168.201.3@tcp:9:kworker.0 Request processed in 626us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837733.372163:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:3.0:1788837733.372622:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837733.372666:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837733.372903:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012757760 00000100:00100000:1.0:1788837733.372910:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012757760 00000100:00100000:0.0:1788837733.373003:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012757888 00000100:00100000:0.0:1788837733.373007:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012757888 00000100:00100000:1.0:1788837733.373067:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 233 00000100:00100000:1.0:1788837733.373076:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012757760:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837733.373143:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012757760:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 68us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837733.373150:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 233 00000100:00080000:3.0:1788837733.378131:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788837733.378143:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837733.378307:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 234 00000100:00100000:0.0:1788837733.378320:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012757888:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837733.380059:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012757888:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 1732us (7381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837733.380074:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 234 00010000:00010000:0.0:1788837734.075750:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837735.096974:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837735.865165:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036962560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837735.865283:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837735.865421:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036962560 00000100:00100000:1.0:1788837735.865430:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036962560 00000100:00080000:3.0:1788837735.865472:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837735.865509:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788837735.865522:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036962560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788837735.865588:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837735.865597:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c31b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036962688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837735.865641:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837735.865657:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036962560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837735.865665:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788837735.865682:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036962688 00000100:00100000:1.0:1788837735.865686:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036962688 00000100:00100000:1.0:1788837735.865715:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788837735.865721:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036962688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837735.865732:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788837735.865754:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837735.865768:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036962688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837735.865796:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788837735.868925:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c31b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036962688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837735.869240:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036962560:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788837736.121003:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837737.145072:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837737.401106:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036963072:0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.401178:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837737.401232:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac440a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036963584:0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.401258:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837737.401280:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac440b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036964096:0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.401300:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837737.401322:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788837737.401328:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036962944:0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.401348:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837737.401363:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac440bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036963456:0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.401380:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837737.401397:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac4409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732036963968:0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.401418:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837737.401575:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036963072 00000100:00100000:1.0:1788837737.401584:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036963072 00000100:00100000:1.0:1788837737.401632:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788837737.401642:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac4409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036963072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837737.401699:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac4409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036963072:12345-0@lo:400:kworker.0 Request processed in 58us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837737.401706:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788837737.401742:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036963584 00000100:00100000:1.0:1788837737.401746:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036963584 00000100:00100000:1.0:1788837737.401817:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036964096 00000100:00100000:1.0:1788837737.401821:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036964096 00000100:00100000:1.0:1788837737.401835:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036962944 00000100:00100000:1.0:1788837737.401838:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036962944 00000100:00100000:1.0:1788837737.401848:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036963456 00000100:00100000:1.0:1788837737.401850:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036963456 00000100:00100000:1.0:1788837737.401861:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036963968 00000100:00100000:1.0:1788837737.401863:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036963968 00000100:00100000:1.0:1788837737.401876:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788837737.401881:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac4408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036963584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837737.401915:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac4408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036963584:12345-0@lo:400:kworker.0 Request processed in 33us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837737.401921:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788837737.401933:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788837737.401939:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac4408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036964096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837737.401969:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac4408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036964096:12345-0@lo:400:kworker.0 Request processed in 31us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837737.401975:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788837737.401986:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788837737.401992:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac4408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036962944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837737.402018:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac4408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036962944:12345-0@lo:400:kworker.0 Request processed in 26us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837737.402024:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788837737.402037:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788837737.402042:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac440b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036963456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837737.402068:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac440b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036963456:12345-0@lo:400:kworker.0 Request processed in 26us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837737.402081:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788837737.402092:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788837737.402098:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac4408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732036963968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837737.402126:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac4408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732036963968:12345-0@lo:400:kworker.0 Request processed in 28us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837737.402132:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788837737.402185:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036964480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837737.402214:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837737.402247:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036964480 00000100:00100000:1.0:1788837737.402251:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036964480 00000100:00100000:1.0:1788837737.402275:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788837737.402282:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036964480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788837737.402316:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837737.402352:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036964480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837737.402359:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:1.0:1788837737.402400:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c35d5180 x1875732036964480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837737.402417:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036964480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837737.402707:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036963200:0@lo:400:kworker.0 00000100:00100000:0.0:1788837737.402741:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837737.402762:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac440ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036963712:0@lo:400:kworker.0 00000100:00100000:0.0:1788837737.402828:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837737.402842:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac440b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036964224:0@lo:400:kworker.0 00000100:00100000:0.0:1788837737.402859:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837737.402879:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788837737.402884:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036962816:0@lo:400:kworker.0 00000100:00100000:0.0:1788837737.402910:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837737.402942:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac4409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036963328:0@lo:400:kworker.0 00000100:00100000:0.0:1788837737.402978:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837737.402996:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac4408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036963840:0@lo:400:kworker.0 00000100:00100000:0.0:1788837737.403017:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837737.403046:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac440a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036964352:0@lo:400:kworker.0 00000100:00100000:0.0:1788837737.403075:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837737.403101:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036962816 00000100:00100000:0.0:1788837737.403105:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036962816 00000100:00100000:0.0:1788837737.403135:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788837737.403142:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036962816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837737.403180:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036962816:12345-0@lo:400:kworker.0 Request processed in 38us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837737.403208:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788837737.403238:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036963328 00000100:00100000:0.0:1788837737.403242:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036963328 00000100:00100000:0.0:1788837737.403267:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788837737.403272:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036963328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837737.403302:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036963328:12345-0@lo:400:kworker.0 Request processed in 30us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837737.403308:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788837737.403326:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036963712 00000100:00100000:0.0:1788837737.403329:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036963712 00000100:00100000:0.0:1788837737.403369:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036964224 00000100:00100000:0.0:1788837737.403373:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036964224 00000100:00100000:0.0:1788837737.403384:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036963840 00000100:00100000:0.0:1788837737.403386:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036963840 00000100:00100000:0.0:1788837737.403396:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036964352 00000100:00100000:0.0:1788837737.403399:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036964352 00000100:00100000:0.0:1788837737.403424:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788837737.403429:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036963712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837737.403459:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036963712:12345-0@lo:400:kworker.0 Request processed in 30us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837737.403465:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788837737.403476:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788837737.403482:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036964224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837737.403517:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2512680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036964224:12345-0@lo:400:kworker.0 Request processed in 24us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837737.403523:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788837737.403534:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788837737.403539:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036963840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.403751:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837737.403760:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac4409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036964608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837737.403807:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837737.403834:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036964608 00000100:00100000:3.0:1788837737.403838:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036964608 00000100:00100000:3.0:1788837737.403857:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788837737.403863:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac440aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036964608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788837737.403885:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788837737.403919:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac440aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036964608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837737.403925:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1788837737.403953:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837737.403957:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837737.403974:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837737.403976:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837737.404004:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac4409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036964608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837737.404033:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036962944:0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.404045:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac440bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036963456:0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.404057:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac4409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732036963968:0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.404067:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036963072:0@lo:400:kworker.0 00010000:00080000:3.0:1788837737.404078:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac440a680 x1875732036963584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837737.404087:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac440a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036963584:0@lo:400:kworker.0 00010000:00080000:3.0:1788837737.404098:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac440b800 x1875732036964096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837737.404106:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac440b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036964096:0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.404135:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788837737.404143:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036964352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.404176:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036964352:12345-0@lo:400:kworker.0 Request processed in 34us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837737.404182:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788837737.404226:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036963200 00000100:00100000:3.0:1788837737.404230:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036963200 00000100:00100000:3.0:1788837737.404254:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788837737.404260:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036963200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.404301:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036963200:12345-0@lo:400:kworker.0 Request processed in 41us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837737.404307:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788837737.404332:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036962816:0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.404343:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac4409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036963328:0@lo:400:kworker.0 00010000:00080000:3.0:1788837737.404352:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac440a300 x1875732036964352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837737.404361:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac440a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036964352:0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.404371:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036963200:0@lo:400:kworker.0 00000100:00100000:3.0:1788837737.404381:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac440ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036963712:0@lo:400:kworker.0 00010000:00080000:3.0:1788837737.404390:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac440b100 x1875732036964224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837737.404398:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac440b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036964224:0@lo:400:kworker.0 00000100:00100000:2.0:1788837737.405041:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837737.405457:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036963840:12345-0@lo:400:kworker.0 Request processed in 1915us (2435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837737.405466:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788837737.405652:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac4408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036963840:0@lo:400:kworker.0 00000100:00100000:2.0:1788837737.412725:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c35d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036964736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837737.413380:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837737.419753:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036964736 00000100:00100000:1.0:1788837737.419846:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036964736 00000100:00100000:1.0:1788837737.421290:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788837737.421307:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036964736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837737.421333:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837737.421425:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036964736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (8046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837737.421443:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1788837737.421551:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c35d5180 x1875732036964736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837737.421573:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c35d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036964736:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788837738.168953:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837738.428261:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837738.428286:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036964864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837738.428377:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837738.428761:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036964864 00000100:00100000:0.0:1788837738.428770:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036964864 00000100:00100000:0.0:1788837738.428845:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788837738.428855:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c35d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036964864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837738.428889:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788837738.428949:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c35d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036964864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837738.428957:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788837738.429090:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036964864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837738.489036:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837738.489085:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837738.489126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837738.489149:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837738.489188:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837738.489216:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012758016 00000100:00100000:1.0:1788837738.489217:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012758144 00000100:00100000:3.0:1788837738.489227:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012758016 00000100:00100000:1.0:1788837738.489227:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012758144 00000100:00100000:1.0:1788837738.489280:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012758400 00000100:00100000:1.0:1788837738.489284:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012758400 00000100:00100000:3.0:1788837738.489286:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 371 00000100:00100000:3.0:1788837738.489300:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012758016:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837738.489304:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012758272 00000100:00100000:1.0:1788837738.489308:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012758272 00000100:00100000:1.0:1788837738.489321:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012758528 00000100:00100000:1.0:1788837738.489323:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012758528 00000100:00100000:1.0:1788837738.489356:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 241 00000100:00100000:1.0:1788837738.489365:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac4408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012758144:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837738.489371:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012758016:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 75us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837738.489379:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 371 00000100:00100000:1.0:1788837738.489409:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac4408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012758144:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 45us (384us total) trans 0 rc 0/0 00000100:00080000:3.0:1788837738.489415:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837738.489419:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 241 00000100:00080000:3.0:1788837738.489421:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837738.489437:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 242 00000100:00100000:1.0:1788837738.489444:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 243 00000100:00100000:3.0:1788837738.489449:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac440b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012758400:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837738.489458:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac440ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012758272:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837738.489481:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac440b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012758400:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 36us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837738.489503:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 242 00000100:00100000:3.0:1788837738.489520:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 244 00000100:00100000:3.0:1788837738.489530:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac440a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012758528:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837738.489532:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac440ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012758272:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 74us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837738.489543:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 243 00000100:00100000:3.0:1788837738.489563:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac440a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012758528:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 36us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837738.489570:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 244 00000001:00100000:0.0:1788837738.940475:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3a879e24-3b2f-4404-84c2-9101689d9315 00000020:00000080:0.0:1788837738.940493:0:8433:0:(genops.c:885:class_export_put()) final put ffff8899c3647000/3a879e24-3b2f-4404-84c2-9101689d9315 00000020:00000080:3.0:1788837738.940583:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3647000/3a879e24-3b2f-4404-84c2-9101689d9315 for lustre-OST0000 00000020:00000080:3.0:1788837738.940645:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c3640800 for lustre-OST0000 00010000:00010000:3.0:1788837739.192943:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837740.218637:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837740.984979:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036964992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837740.985062:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837740.985142:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036964992 00000100:00100000:2.0:1788837740.985151:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036964992 00000100:00100000:2.0:1788837740.985214:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788837740.985225:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036964992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837740.985256:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837740.986099:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036965120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837740.986156:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837740.993790:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036964992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8543us (8705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837740.993805:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788837740.993837:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036965120 00000100:00100000:2.0:1788837740.993846:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036965120 00000100:00100000:2.0:1788837740.993882:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788837740.993891:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac4409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036965120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837740.993914:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837740.993981:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac4409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036965120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (7824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837740.993987:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1788837740.994005:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837740.994047:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036965120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837740.995666:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036964992:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788837741.242872:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837742.073449:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788837742.137754:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788837742.281105:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837742.521956:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac440b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036965248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837742.522033:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837742.522086:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac4409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036965760:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.522162:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837742.522183:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036966272:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.522208:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837742.522226:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036966784:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.522247:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837742.522284:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788837742.522291:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac440a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036965376:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.522323:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837742.522347:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac4409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036965888:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.522386:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837742.522404:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036966400:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.522438:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837742.522456:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036966912:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.522476:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837742.522507:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac4409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036965504:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.522545:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837742.522565:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036966016:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.522584:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837742.522598:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036966528:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.522645:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837742.522661:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788837742.522667:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac440bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036965632:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.522686:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837742.522701:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036966144:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.522719:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837742.522728:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036966656:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.522744:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837742.522767:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036965760 00000100:00100000:3.0:1788837742.522795:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036965760 00000100:00100000:3.0:1788837742.522835:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036965504 00000100:00100000:3.0:1788837742.522839:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036965504 00000100:00100000:3.0:1788837742.522853:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788837742.522860:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036965760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.522912:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036965760:12345-0@lo:400:kworker.0 Request processed in 51us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837742.522918:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788837742.522932:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036966016 00000100:00100000:3.0:1788837742.522935:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036966016 00000100:00100000:3.0:1788837742.522954:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036966528 00000100:00100000:3.0:1788837742.522957:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036966528 00000100:00100000:3.0:1788837742.522969:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036966144 00000100:00100000:3.0:1788837742.522972:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036966144 00000100:00100000:3.0:1788837742.522985:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036966656 00000100:00100000:3.0:1788837742.522987:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036966656 00000100:00100000:3.0:1788837742.523000:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788837742.523006:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036965504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523037:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036965504:12345-0@lo:400:kworker.0 Request processed in 32us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837742.523051:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788837742.523063:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788837742.523070:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036966016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523101:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036966016:12345-0@lo:400:kworker.0 Request processed in 32us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837742.523107:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788837742.523118:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788837742.523124:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036966528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523149:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036966528:12345-0@lo:400:kworker.0 Request processed in 25us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837742.523154:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788837742.523165:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788837742.523171:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036966144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523212:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036966144:12345-0@lo:400:kworker.0 Request processed in 41us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837742.523218:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788837742.523232:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788837742.523238:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036966656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523262:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036966656:12345-0@lo:400:kworker.0 Request processed in 25us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837742.523267:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788837742.523283:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036966272 00000100:00100000:3.0:1788837742.523286:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036966272 00000100:00100000:3.0:1788837742.523304:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036966784 00000100:00100000:3.0:1788837742.523306:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036966784 00000100:00100000:3.0:1788837742.523325:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036966400 00000100:00100000:3.0:1788837742.523328:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036966400 00000100:00100000:3.0:1788837742.523337:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036966912 00000100:00100000:3.0:1788837742.523340:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036966912 00000100:00100000:3.0:1788837742.523351:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788837742.523355:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036966272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523386:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036966272:12345-0@lo:400:kworker.0 Request processed in 30us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837742.523392:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788837742.523403:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788837742.523408:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036966784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523448:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036966784:12345-0@lo:400:kworker.0 Request processed in 39us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837742.523453:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788837742.523464:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788837742.523469:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036966400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523494:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036966400:12345-0@lo:400:kworker.0 Request processed in 25us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837742.523499:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788837742.523510:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788837742.523516:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036966912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523542:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036966912:12345-0@lo:400:kworker.0 Request processed in 26us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837742.523547:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788837742.523566:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036965376 00000100:00100000:3.0:1788837742.523570:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036965376 00000100:00100000:3.0:1788837742.523596:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788837742.523610:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036965376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523639:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036965376:12345-0@lo:400:kworker.0 Request processed in 32us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837742.523645:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788837742.523672:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036965888 00000100:00100000:3.0:1788837742.523676:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036965888 00000100:00100000:3.0:1788837742.523698:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036965632 00000100:00100000:3.0:1788837742.523701:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036965632 00000100:00100000:3.0:1788837742.523714:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788837742.523719:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036965888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523749:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036965888:12345-0@lo:400:kworker.0 Request processed in 30us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837742.523755:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788837742.523766:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788837742.523772:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036965632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523828:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036965632:12345-0@lo:400:kworker.0 Request processed in 56us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837742.523835:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788837742.523879:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac440a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036965376:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523892:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac4409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036965888:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523904:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036966400:0@lo:400:kworker.0 00010000:00080000:3.0:1788837742.523916:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ad17af100 x1875732036966912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837742.523926:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036966912:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523950:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac4409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036965760:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.523960:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036966272:0@lo:400:kworker.0 00010000:00080000:3.0:1788837742.523969:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ad17af800 x1875732036966784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837742.523977:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036966784:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.524017:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac440bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036965632:0@lo:400:kworker.0 00010000:00080000:3.0:1788837742.524028:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3345880 x1875732036966144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837742.524036:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036966144:0@lo:400:kworker.0 00010000:00080000:3.0:1788837742.524045:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ad17ad180 x1875732036966656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837742.524052:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036966656:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.524061:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac4409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036965504:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.524071:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036966016:0@lo:400:kworker.0 00000100:00100000:3.0:1788837742.524080:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036966528:0@lo:400:kworker.0 00000100:00100000:2.0:1788837742.525234:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837742.525250:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036967040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837742.525299:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837742.525352:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036965248 00000100:00100000:2.0:1788837742.525357:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036965248 00000100:00100000:2.0:1788837742.525387:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036967040 00000100:00100000:2.0:1788837742.525391:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036967040 00000100:00100000:2.0:1788837742.525405:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788837742.525412:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036965248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837742.525451:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837742.525493:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036965248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (3461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837742.525501:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788837742.525516:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788837742.525524:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036967040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837742.525533:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837742.525559:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036967040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837742.525564:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1788837742.525586:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837742.525591:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837742.525593:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837742.525596:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788837742.525637:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac440b800 x1875732036965248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837742.525656:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac440b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036965248:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788837742.525685:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa735f80 x1875732036967040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837742.525695:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036967040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837742.528978:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837742.529002:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036967168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837742.529073:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837742.529553:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036967168 00000100:00100000:0.0:1788837742.529562:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036967168 00000100:00100000:0.0:1788837742.529627:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788837742.529638:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036967168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837742.529674:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788837742.529737:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036967168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837742.529744:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788837742.529905:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036967168:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788837743.297139:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837743.552538:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837743.552563:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036967296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837743.552675:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837743.552743:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036967296 00000100:00100000:0.0:1788837743.552751:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036967296 00000100:00100000:0.0:1788837743.552817:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788837743.552826:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036967296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837743.552861:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788837743.552910:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036967296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837743.552916:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788837743.552964:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036967296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837743.603112:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837743.603155:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837743.603177:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837743.603197:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837743.603220:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837743.603244:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012758912 00000100:00100000:2.0:1788837743.603253:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012758912 00000100:00100000:2.0:1788837743.603300:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012759168 00000100:00100000:2.0:1788837743.603304:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012759168 00000100:00100000:2.0:1788837743.603316:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012758784 00000100:00100000:2.0:1788837743.603318:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012758784 00000100:00100000:2.0:1788837743.603327:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012759040 00000100:00100000:2.0:1788837743.603329:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012759040 00000100:00100000:2.0:1788837743.603343:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 251 00000100:00100000:2.0:1788837743.603352:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012758912:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837743.603607:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012758656 00000100:00100000:3.0:1788837743.603612:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012758656 00000100:00100000:3.0:1788837743.603649:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 373 00000100:00100000:3.0:1788837743.603657:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012758656:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837743.603716:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012758656:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 60us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837743.603723:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 373 00000100:00100000:2.0:1788837743.604005:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012758912:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 653us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837743.604013:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 251 00000100:00100000:2.0:1788837743.604029:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 252 00000100:00100000:2.0:1788837743.604035:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012759168:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837743.604061:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012759168:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 26us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837743.604068:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 252 00000100:00100000:2.0:1788837743.604080:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 253 00000100:00100000:2.0:1788837743.604086:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012758784:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837743.604111:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012758784:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 25us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837743.604124:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 253 00000100:00100000:2.0:1788837743.604135:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 254 00000100:00100000:2.0:1788837743.604140:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c25b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012759040:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837743.604460:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c25b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012759040:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 318us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837743.604467:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 254 00000100:00080000:2.0:1788837743.604498:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837743.604502:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788837744.312971:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837745.337766:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837746.106640:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837746.106665:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036967424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837746.106827:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837746.106914:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036967424 00000100:00100000:3.0:1788837746.106922:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036967424 00000100:00100000:3.0:1788837746.106979:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788837746.106988:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036967424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788837746.107019:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837746.107092:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036967424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837746.107100:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1788837746.107121:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837746.107158:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036967424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837746.107231:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036967552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837746.107257:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837746.107286:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036967552 00000100:00100000:3.0:1788837746.107290:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036967552 00000100:00100000:3.0:1788837746.107577:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788837746.107586:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036967552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837746.107598:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837746.107633:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036967552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837746.107652:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1788837746.107666:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837746.107686:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036967552:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837746.362256:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788837746.692194:0:14066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:22:25 (1788837745) 00010000:00010000:2.0:1788837747.384987:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837747.641319:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036967936:0@lo:400:kworker.0 00000100:00100000:1.0:1788837747.641385:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036967680:0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.641415:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837747.641470:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036968064:0@lo:400:kworker.0 00000100:00100000:2.0:1788837747.641523:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036967808:0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.641554:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac440b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732036968448:0@lo:400:kworker.0 00000100:00100000:2.0:1788837747.641567:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837747.641601:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837747.641605:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036968320:0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.641629:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac4409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732036968960:0@lo:400:kworker.0 00000100:00100000:2.0:1788837747.641636:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837747.641668:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837747.641671:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac4409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036968832:0@lo:400:kworker.0 00000100:00100000:2.0:1788837747.641702:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837747.641721:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036967936 00000100:00100000:3.0:1788837747.641731:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036967936 00000100:00100000:2.0:1788837747.641807:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036967808 00000100:00100000:2.0:1788837747.641811:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036967808 00000100:00100000:3.0:1788837747.641816:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788837747.641829:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036967936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837747.641839:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036968448 00000100:00100000:2.0:1788837747.641843:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036968448 00000100:00100000:2.0:1788837747.641869:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036968320 00000100:00100000:2.0:1788837747.641873:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036968320 00000100:00100000:2.0:1788837747.641890:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036968960 00000100:00100000:2.0:1788837747.641894:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036968960 00000100:00100000:3.0:1788837747.641899:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036967936:12345-0@lo:400:kworker.0 Request processed in 74us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837747.641908:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036968832 00000100:00100000:3.0:1788837747.641912:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788837747.641913:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036968832 00000100:00100000:2.0:1788837747.641945:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788837747.641953:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036967808:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788837747.641971:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837747.641977:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837747.641991:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7f5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036969472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837747.641998:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732036967808:12345-0@lo:400:kworker.0 Request processed in 45us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837747.642005:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788837747.642021:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788837747.642026:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837747.642031:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732036968448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837747.642070:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732036968448:12345-0@lo:400:kworker.0 Request processed in 42us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837747.642074:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036967936:0@lo:400:kworker.0 00000100:00100000:2.0:1788837747.642079:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00010000:00080000:3.0:1788837747.642095:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac440b800 x1875732036968448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837747.642097:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788837747.642109:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036968320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.642112:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac440b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732036968448:0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.642145:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837747.642146:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732036968320:12345-0@lo:400:kworker.0 Request processed in 39us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837747.642155:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036969344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837747.642156:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788837747.642175:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788837747.642183:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732036968960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.642191:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837747.642226:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732036968960:12345-0@lo:400:kworker.0 Request processed in 44us (561us total) trans 0 rc 0/0 00010000:00080000:3.0:1788837747.642229:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac4409500 x1875732036968960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837747.642240:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788837747.642250:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac4409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732036968960:0@lo:400:kworker.0 00000100:00100000:2.0:1788837747.642261:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788837747.642269:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036968832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.642275:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036969472 00000100:00100000:3.0:1788837747.642281:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036969472 00000100:00100000:2.0:1788837747.642297:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875732036968832:12345-0@lo:400:kworker.0 Request processed in 29us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837747.642304:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788837747.642338:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036969344 00000100:00100000:3.0:1788837747.642343:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036969344 00000100:00100000:3.0:1788837747.642363:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788837747.642371:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732036967808:0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.642373:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036969472:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837747.642389:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732036968320:0@lo:400:kworker.0 00000100:00100000:2.0:1788837747.642401:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac4409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875732036968832:0@lo:400:kworker.0 00002000:00000024:3.0:1788837747.642402:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788837747.642448:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837747.642451:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036969472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837747.642460:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:2.0:1788837747.642478:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7f5b800 x1875732036969472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837747.642479:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788837747.642491:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036969344:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837747.642497:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7f5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036969472:0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837747.642502:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837747.642544:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036969344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837747.642552:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:2.0:1788837747.642571:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3c18700 x1875732036969344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837747.642584:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036969344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837747.654217:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837747.654307:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036968192:0@lo:400:kworker.0 00000100:00100000:1.0:1788837747.654388:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837747.654427:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac440bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036968704:0@lo:400:kworker.0 00000100:00100000:1.0:1788837747.654458:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837747.654482:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7f5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036969216:0@lo:400:kworker.0 00000100:00100000:1.0:1788837747.654505:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837747.654533:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837747.654539:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036969600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837747.654561:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837747.654598:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036968704 00000100:00100000:1.0:1788837747.654606:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036968704 00000100:00100000:1.0:1788837747.654655:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036969216 00000100:00100000:1.0:1788837747.654658:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036969216 00000100:00100000:1.0:1788837747.654684:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788837747.654692:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036968704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.655287:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036967680 00000100:00100000:3.0:1788837747.655294:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036967680 00000100:00100000:0.0:1788837747.655298:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837747.655336:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac4409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036968576:0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.655339:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788837747.655347:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732036967680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837747.655364:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837747.655376:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac440a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036969088:0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.655404:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732036967680:12345-0@lo:400:kworker.0 Request processed in 58us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837747.655404:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837747.655411:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788837747.655428:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036968064 00000100:00100000:0.0:1788837747.655431:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036968064 00000100:00100000:3.0:1788837747.655446:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036968192 00000100:00100000:3.0:1788837747.655449:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036968192 00000100:00100000:0.0:1788837747.655457:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788837747.655463:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036968064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.655468:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036969600 00000100:00100000:3.0:1788837747.655471:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036969600 00000100:00100000:3.0:1788837747.655482:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788837747.655488:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c379ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875732036968192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837747.655499:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036968064:12345-0@lo:400:kworker.0 Request processed in 37us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837747.655506:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788837747.655516:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c379ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875732036968192:12345-0@lo:400:kworker.0 Request processed in 29us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837747.655523:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788837747.655533:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788837747.655538:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036969600:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837747.655548:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036968064:0@lo:400:kworker.0 00000004:00000024:3.0:1788837747.655560:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788837747.655587:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036968576 00000100:00100000:0.0:1788837747.655591:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036968576 00000100:00100000:0.0:1788837747.655606:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036969088 00000100:00100000:3.0:1788837747.655608:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036969600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837747.655608:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036969088 00000100:00100000:3.0:1788837747.655614:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788837747.655619:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788837747.655625:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036969216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.655645:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788837747.655652:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788837747.655656:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036969216:12345-0@lo:400:kworker.0 Request processed in 31us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837747.655662:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788837747.655676:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788837747.655680:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036968576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.655755:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788837747.655761:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036969088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837747.655847:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036968704:12345-0@lo:400:kworker.0 Request processed in 1155us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837747.655855:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788837747.655892:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036969600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837747.655902:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732036967680:0@lo:400:kworker.0 00000100:00100000:1.0:1788837747.655925:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036968192:0@lo:400:kworker.0 00000100:00100000:1.0:1788837747.655935:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac440bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036968704:0@lo:400:kworker.0 00010000:00080000:1.0:1788837747.655947:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7f5a680 x1875732036969216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837747.655959:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7f5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036969216:0@lo:400:kworker.0 00000100:00100000:3.0:1788837747.655989:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036969088:12345-0@lo:400:kworker.0 Request processed in 225us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837747.655998:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:1.0:1788837747.656029:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac440a680 x1875732036969088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837747.656038:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac440a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036969088:0@lo:400:kworker.0 00000100:00100000:0.0:1788837747.661243:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036968576:12345-0@lo:400:kworker.0 Request processed in 5552us (5868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837747.661259:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788837747.661888:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac4409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036968576:0@lo:400:kworker.0 00000100:00100000:1.0:1788837748.222596:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837748.222927:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012759296 00000100:00100000:2.0:1788837748.222939:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012759296 00000100:00100000:2.0:1788837748.223046:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:2.0:1788837748.223054:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+5:11057:x1875732012759296:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837748.223072:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837748.223092:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef2a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea1a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837748.223146:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef2ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837748.223159:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef2ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837748.223168:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef2ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837748.223221:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788837748.223224:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788837748.223253:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef2ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837748.223271:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef2a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea1a expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837748.223284:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef2ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea1a expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837748.223289:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889afa694a00) 00010000:00010000:2.0:1788837748.223292:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837748.223294:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6dae00, rc 0) 00000100:00100000:2.0:1788837748.223452:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:11057:x1875732012759296:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 397us (864us total) trans 0 rc 0/0 00000100:00080000:3.0:1788837748.223951:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837748.223996:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:2.0:1788837748.236411:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837748.238468:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012759424 00000100:00100000:0.0:1788837748.238486:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012759424 00000100:00100000:0.0:1788837748.239335:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:0.0:1788837748.239353:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:11058:x1875732012759424:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837748.239391:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837748.239413:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef2b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea21 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239481:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239495:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239507:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239533:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239540:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239547:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239619:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef2c8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239627:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239634:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837748.239673:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788837748.239683:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788837748.239708:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239719:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239726:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239734:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239740:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837748.239744:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239764:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239794:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889afa694a00) 00010000:00010000:0.0:1788837748.239798:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837748.239804:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239811:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239826:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239832:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239849:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239855:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837748.239858:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239864:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239873:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff889aded2cd00) 00010000:00010000:0.0:1788837748.239875:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837748.239878:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239884:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239916:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef2b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea21 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239929:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea21 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.239936:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff889aded2ca00) 00010000:00010000:0.0:1788837748.239938:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837748.239941:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790a00, rc 0) 00000100:00100000:0.0:1788837748.240014:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:11058:x1875732012759424:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 668us (3614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837748.240031:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:1.0:1788837748.243274:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837748.243372:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012759552 00000100:00100000:2.0:1788837748.243383:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012759552 00000100:00100000:2.0:1788837748.243439:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:2.0:1788837748.243448:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3a879e24-3b2f-4404-84c2-9101689d9315+7:11058:x1875732012759552:12345-192.168.201.3@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788837748.243538:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3a879e24-3b2f-4404-84c2-9101689d9315+7:11058:x1875732012759552:12345-192.168.201.3@tcp:900:lhsmtool_posix.0 Request processed in 91us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837748.243546:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:1.0:1788837748.252126:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837748.252229:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012759808 00000100:00100000:0.0:1788837748.252240:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012759808 00000100:00100000:0.0:1788837748.252304:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:0.0:1788837748.252314:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:11058:x1875732012759808:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837748.252344:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837748.252365:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef2cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea28 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252436:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252451:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252463:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252524:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252542:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252550:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252660:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790600/0x57f6d4e926aef2e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252685:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790600/0x57f6d4e926aef2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252693:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790600/0x57f6d4e926aef2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837748.252702:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788837748.252862:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252870:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252877:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252883:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837748.252888:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252895:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252908:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff889aded2ca00) 00010000:00010000:0.0:1788837748.252911:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837748.252917:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252923:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef2d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252939:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252951:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252957:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252962:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837748.252965:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252971:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252980:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff889aded2cd00) 00010000:00010000:0.0:1788837748.252982:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837748.252985:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.252990:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef2dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.253258:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef2cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea28 expref: 10 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.253273:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790600/0x57f6d4e926aef2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea28 expref: 9 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837748.253280:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aded2c400) 00010000:00010000:0.0:1788837748.253282:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837748.253292:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790600, rc 0) 00000100:00100000:0.0:1788837748.253370:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+9:11058:x1875732012759808:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 1056us (1254us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788837748.253377:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:3.0:1788837748.261497:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837748.261825:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012759936 00000100:00100000:0.0:1788837748.261835:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012759936 00000100:00100000:0.0:1788837748.261902:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:0.0:1788837748.261913:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+9:11058:x1875732012759936:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788837748.262022:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+9:11058:x1875732012759936:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 Request processed in 110us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837748.262030:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:1.0:1788837748.264016:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837748.264130:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012760064 00000100:00100000:0.0:1788837748.264139:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012760064 00000100:00100000:0.0:1788837748.264209:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:0.0:1788837748.264220:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:11058:x1875732012760064:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788837748.264499:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788837748.271401:0:9317:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7137us 00000100:00100000:2.0:1788837748.294173:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:11058:x1875732012760064:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 Request processed in 29948us (30159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837748.294189:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 44 00010000:00010000:2.0:1788837748.408980:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837748.665183:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036969728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837748.665258:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837748.665377:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036969728 00000100:00100000:2.0:1788837748.665385:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036969728 00000100:00100000:2.0:1788837748.665439:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788837748.665450:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036969728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788837748.665485:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788837748.673793:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036969728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8317us (8506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837748.673810:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788837748.674099:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036969728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837748.727223:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837748.727266:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837748.727338:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837748.727372:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012760320 00000100:00100000:1.0:1788837748.727382:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012760320 00000100:00100000:1.0:1788837748.727439:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012760448 00000100:00100000:1.0:1788837748.727442:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012760448 00000100:00100000:1.0:1788837748.727466:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 261 00000100:00100000:1.0:1788837748.727485:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012760320:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837748.727564:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012760320:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 82us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837748.727572:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 261 00000100:00100000:1.0:1788837748.727590:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 262 00000100:00100000:1.0:1788837748.727598:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012760448:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837748.727622:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012760448:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837748.727627:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 262 00000100:00100000:3.0:1788837748.727851:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012760192 00000100:00100000:3.0:1788837748.727856:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012760192 00000100:00100000:3.0:1788837748.727898:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 375 00000100:00100000:3.0:1788837748.727906:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012760192:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837748.727939:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012760192:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 35us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837748.727945:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 375 00000100:00080000:3.0:1788837748.728076:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788837748.728081:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788837749.241450:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788837749.305662:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788837749.438348:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837750.353385:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837750.353505:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012760576 00000100:00100000:3.0:1788837750.353518:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012760576 00000100:00100000:3.0:1788837750.353598:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:3.0:1788837750.353612:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+9:11101:x1875732012760576:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788837750.353634:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837750.353655:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031400/0x57f6d4e926aef2f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea2f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353721:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef2f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353735:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef2f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353748:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef2f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353763:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef300 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353810:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353817:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353859:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef2f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353866:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef2f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353872:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef2f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353878:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0030a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837750.353883:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef2f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353890:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef2f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353902:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889afa694a00) 00010000:00010000:3.0:1788837750.353905:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837750.353910:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef2f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353915:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef2f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353929:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353940:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353946:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef300 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353951:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0031800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837750.353954:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef300 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353959:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef300 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353967:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff889ad8ad9400) 00010000:00010000:3.0:1788837750.353969:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837750.353972:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef300 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.353977:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef300 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788837750.354144:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788837750.354255:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031400/0x57f6d4e926aef2f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea2f expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.354265:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889afa694a00) 00010000:00010000:3.0:1788837750.354268:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837750.354271:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031400/0x57f6d4e926aef2f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea2f expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.354291:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0031400, rc 0) 00000100:00100000:3.0:1788837750.354373:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+9:11101:x1875732012760576:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 766us (998us total) trans 0 rc 301/301 00000100:00100000:3.0:1788837750.354382:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:1.0:1788837750.372250:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837750.372548:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012760832 00000100:00100000:1.0:1788837750.372559:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012760832 00000100:00100000:1.0:1788837750.372618:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:1.0:1788837750.372631:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+9:11101:x1875732012760832:12345-192.168.201.3@tcp:36:lfs.0 00010000:00010000:1.0:1788837750.372694:0:9317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837750.372722:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef2ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea1a expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.372739:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889afa694a00) 00010000:00010000:1.0:1788837750.372751:0:9317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837750.373239:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef307 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.373256:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef307 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.373276:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef307 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.373300:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef30e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.373307:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef30e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.373314:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef30e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.377069:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef315 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.377092:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef315 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.377104:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef315 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837750.377124:0:9317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021dce78a reply state 0000000006727198 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef315 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.377136:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef315 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.377142:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:1.0:1788837750.377145:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788837750.377150:0:9317:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788837750.377288:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788837750.377299:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef307 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.377313:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef307 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.377319:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef307 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.377325:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837750.377330:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef307 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.377337:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef307 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.377348:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:1.0:1788837750.377351:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837750.377355:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef307 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.377361:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef307 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837750.377377:0:9317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021dce78a reply state 0000000006727198 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef30e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.377386:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef30e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.377392:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff889b01a1fa00) 00010000:00010000:1.0:1788837750.377395:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788837750.377397:0:9317:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788837750.377510:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+10:11101:x1875732012760832:12345-192.168.201.3@tcp:36:lfs.0 Request processed in 4879us (5271us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788837750.377525:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 46 00010000:00010000:2.0:1788837750.457484:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837750.519536:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837750.519608:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012760960 00000100:00100000:3.0:1788837750.519618:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012760960 00000100:00100000:3.0:1788837750.519669:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:3.0:1788837750.519676:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+10:11109:x1875732012760960:12345-192.168.201.3@tcp:101:lctl.0 00010000:00010000:3.0:1788837750.519697:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837750.519723:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031400/0x57f6d4e926aef31c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea36 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.519826:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef323 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.519839:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.519848:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837750.519897:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788837750.519900:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837750.519929:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef323 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.519947:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031400/0x57f6d4e926aef31c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea36 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.519961:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef323 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea36 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.520116:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ad8ad9400) 00010000:00010000:3.0:1788837750.520120:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837750.520123:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0031800, rc 0) 00000100:00100000:3.0:1788837750.520189:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+11:11109:x1875732012760960:12345-192.168.201.3@tcp:101:lctl.0 Request processed in 513us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837750.520194:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:3.0:1788837750.616610:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837750.617183:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012761088 00000100:00100000:1.0:1788837750.617195:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012761088 00000100:00100000:1.0:1788837750.617259:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 48 00000100:00100000:1.0:1788837750.617269:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+11:11115:x1875732012761088:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788837750.617299:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837750.617320:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef32a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea3d expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617389:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef331 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617404:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef331 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617416:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef331 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617428:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef338 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617435:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617443:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617535:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8e00/0x57f6d4e926aef33f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617563:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8e00/0x57f6d4e926aef33f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617571:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8e00/0x57f6d4e926aef33f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837750.617607:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788837750.617611:0:9317:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837750.617652:0:9317:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8e00/0x57f6d4e926aef33f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617665:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef331 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617672:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef331 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617679:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef331 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617685:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837750.617689:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef331 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617696:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef331 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617709:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ad8ad9400) 00010000:00010000:1.0:1788837750.617712:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837750.617716:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef331 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617732:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef331 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617746:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef338 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617752:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef338 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617758:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef338 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617763:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837750.617766:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef338 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617772:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef338 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617839:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff889b01a1fa00) 00010000:00010000:1.0:1788837750.617842:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837750.617845:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef338 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617851:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef338 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617879:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef32a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea3d expref: 13 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617891:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8e00/0x57f6d4e926aef33f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea3d expref: 12 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.617904:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:1.0:1788837750.617907:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788837750.617909:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8e00, rc 0) 00000100:00100000:1.0:1788837750.617997:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+12:11115:x1875732012761088:12345-192.168.201.3@tcp:101:bash.0 Request processed in 728us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837750.618004:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 48 00000100:00100000:2.0:1788837750.621664:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837750.621754:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012761344 00000100:00100000:3.0:1788837750.621765:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012761344 00000100:00100000:3.0:1788837750.621881:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 49 00000100:00100000:3.0:1788837750.621892:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+12:11115:x1875732012761344:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788837750.621913:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837750.621934:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031400/0x57f6d4e926aef346 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea44 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.622309:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef34d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.622328:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef34d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.622340:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef34d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.622407:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef354 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.622415:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef354 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.622438:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef354 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837750.627318:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788837750.627560:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef35b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.627581:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef35b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.627593:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef35b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.627630:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef34d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.627637:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef34d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.627644:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef34d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.627650:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0030a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837750.627654:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef34d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.627661:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef34d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.627673:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:3.0:1788837750.627676:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837750.627696:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef34d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.627702:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef34d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837750.627718:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee8a4816 reply state 0000000008222af2 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef354 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.627730:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef354 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.627736:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889ad8ad9000) 00010000:00010000:3.0:1788837750.627739:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788837750.627742:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788837750.627799:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031400/0x57f6d4e926aef346 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea44 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.627815:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef35b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea44 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.627822:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889ad8ad9c00) 00010000:00010000:3.0:1788837750.627825:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837750.627827:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17e00, rc 0) 00000100:00100000:3.0:1788837750.627914:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+15:11115:x1875732012761344:12345-192.168.201.3@tcp:101:bash.0 Request processed in 6023us (6260us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788837750.627924:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 49 00000100:00100000:2.0:1788837750.636357:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837750.636432:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012761472 00000100:00100000:1.0:1788837750.636442:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012761472 00000100:00100000:1.0:1788837750.636502:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:1.0:1788837750.636511:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875732012761472:12345-192.168.201.3@tcp:8:bash.0 00010000:00080000:1.0:1788837750.636551:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp t0 exp 0000000000000000 cur 367 last 0 00000020:00000080:1.0:1788837750.636588:0:8439:0:(genops.c:1385:class_connect()) connect: client 3a879e24-3b2f-4404-84c2-9101689d9315, cookie 0x57f6d4e926aef369 00002000:00100000:1.0:1788837750.636604:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3a879e24-3b2f-4404-84c2-9101689d9315/ffff8899c356b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788837750.636625:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788837750.636709:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788837750.636736:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8899c356a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837750.636864:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2392:x1875732012761472:12345-192.168.201.3@tcp:8:bash.0 Request processed in 352us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837750.636871:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:2.0:1788837750.642541:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837750.642694:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012761600 00000100:00100000:3.0:1788837750.642705:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012761600 00000100:00100000:3.0:1788837750.642827:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:3.0:1788837750.642843:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:0:x1875732012761600:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788837750.642882:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837750.642908:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008480f130/0x57f6d4e926aef370 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea4b expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837750.642939:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837750.642960:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1788837750.642965:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837750.642975:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008480f130/0x57f6d4e926aef370 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea4b expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.643011:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008480f130/0x57f6d4e926aef370 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea4b expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.643025:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17800, rc 0) 00000100:00100000:3.0:1788837750.643079:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:0:x1875732012761600:12345-192.168.201.3@tcp:101:bash.0 Request processed in 244us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837750.643086:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00080000:0.0:1788837750.643482:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837750.648234:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837750.648404:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012761728 00000100:00100000:0.0:1788837750.648415:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012761728 00000100:00100000:0.0:1788837750.648479:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:0.0:1788837750.648490:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:11115:x1875732012761728:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:0.0:1788837750.648510:0:8544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837750.648530:0:8544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea52 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.648583:0:8544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008480f130/0x57f6d4e926aef370 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea4b expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.648592:0:8544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837750.648597:0:8544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837750.648602:0:8544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 8 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.648643:0:8544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008480f130/0x57f6d4e926aef370 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea4b expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.648656:0:8544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008480f130/0x57f6d4e926aef370 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea4b expref: 8 pid: 8441 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837750.648671:0:8544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8544:1875732036969856:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837750.648816:0:8544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837750.656450:0:8544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8544:1875732036969856:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837750.656489:0:8544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 8 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.656511:0:8544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791200, rc 0) 00000100:00100000:0.0:1788837750.656598:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+8:11115:x1875732012761728:12345-192.168.201.3@tcp:101:bash.0 Request processed in 8109us (8375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837750.656606:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:3.0:1788837750.657526:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837750.657947:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012761856 00000100:00100000:1.0:1788837750.657957:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012761856 00010000:00010000:1.0:1788837750.658013:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008480f130/0x57f6d4e926aef370 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea4b expref: 8 pid: 8441 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837750.658053:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:1.0:1788837750.658077:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+8:2395:x1875732012761856:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837750.658107:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837750.658132:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008480f130/0x57f6d4e926aef370 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea4b expref: 8 pid: 8441 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.658157:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008480f130/0x57f6d4e926aef370 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea4b expref: 8 pid: 8441 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.658183:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008480f130/0x57f6d4e926aef370 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea4b expref: 8 pid: 8441 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.658200:0:9528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837750.658204:0:9528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837750.658212:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 7 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.658222:0:9528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 7 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.658260:0:9528:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 7 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837750.658284:0:9528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affbdaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9528:1875732036969984:192.168.201.3@tcp:105: 00000100:00100000:1.0:1788837750.658363:0:9528:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f40540 going to sleep for 11 seconds 00000100:00100000:3.0:1788837750.663405:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837750.663498:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012762112 00000100:00100000:2.0:1788837750.663509:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012762112 00000100:00100000:2.0:1788837750.663577:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:2.0:1788837750.663589:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+15:11115:x1875732012762112:12345-192.168.201.3@tcp:35:bash.0 00000001:00080000:2.0:1788837750.663863:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967314 00000100:00100000:2.0:1788837750.663986:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+17:11115:x1875732012762112:12345-192.168.201.3@tcp:35:bash.0 Request processed in 399us (592us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788837750.663993:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00000020:00080000:2.0:1788837750.663998:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788837750.664713:0:9528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affbdaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9528:1875732036969984:192.168.201.3@tcp:105: 00010000:00010000:1.0:1788837750.664762:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837750.664817:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012761856:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 6742us (7293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837750.664826:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:3.0:1788837750.813252:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837750.813375:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012762368 00000100:00100000:1.0:1788837750.813385:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012762368 00000100:00100000:1.0:1788837750.813453:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:1.0:1788837750.813465:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+17:11125:x1875732012762368:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788837750.813608:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837750.813635:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef37e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea59 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837750.813760:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788837750.818337:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef37e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea59 expref: 19 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.818365:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ad8ad9400) 00010000:00010000:0.0:1788837750.818369:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837750.818376:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef37e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea59 expref: 19 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.818395:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8c00, rc 0) 00000100:00100000:0.0:1788837750.818562:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+18:11125:x1875732012762368:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 5098us (5423us total) trans 4294967316 rc 301/301 00000100:00100000:0.0:1788837750.818573:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:0.0:1788837750.821592:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837750.821681:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012762624 00000100:00100000:2.0:1788837750.821705:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012762624 00000100:00100000:2.0:1788837750.821765:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:2.0:1788837750.821900:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+18:11125:x1875732012762624:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788837750.827489:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+19:11125:x1875732012762624:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 5694us (5886us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788837750.827503:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:2.0:1788837750.926929:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837750.927109:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012762752 00000100:00100000:1.0:1788837750.927122:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012762752 00000100:00100000:1.0:1788837750.927233:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:1.0:1788837750.927244:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+19:11131:x1875732012762752:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788837750.927299:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837750.927326:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef38c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea60 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.927404:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef393 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.927421:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.927434:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837750.927508:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788837750.927512:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837750.927534:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.927563:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef38c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea60 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.927583:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef393 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea60 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.927593:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:1.0:1788837750.927596:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837750.927599:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9200, rc 0) 00000100:00100000:1.0:1788837750.927672:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+20:11131:x1875732012762752:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 430us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837750.927679:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:3.0:1788837750.934308:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837750.938669:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012763008 00000100:00100000:0.0:1788837750.938689:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012763008 00000100:00100000:0.0:1788837750.938842:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:0.0:1788837750.938854:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+20:11131:x1875732012763008:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837750.938892:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837750.938917:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef39a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea67 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.939055:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef3a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.939071:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.939082:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837750.939113:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788837750.939231:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef39a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea67 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.939250:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea67 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837750.939258:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889ad8ad9c00) 00010000:00010000:0.0:1788837750.939261:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837750.939265:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791800, rc 0) 00000100:00100000:0.0:1788837750.939349:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+22:11131:x1875732012763008:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 498us (5052us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788837750.939356:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:0.0:1788837750.947094:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837750.947154:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837750.947346:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012763264 00000100:00100000:3.0:1788837750.947357:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012763264 00000100:00100000:3.0:1788837750.947425:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:3.0:1788837750.947435:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+22:11131:x1875732012763264:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788837750.947459:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837750.947497:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef3af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea6e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.947607:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef3b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.947623:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef3b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.947635:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef3b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837750.947647:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788837750.947752:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef3af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea6e expref: 25 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.947773:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef3b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea6e expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.947815:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889ad8ad9c00) 00010000:00010000:3.0:1788837750.947818:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788837750.947822:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17c00, rc 0) 00000100:00100000:3.0:1788837750.947902:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+24:11131:x1875732012763264:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 467us (818us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788837750.947909:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:1.0:1788837750.948716:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012763392 00000100:00100000:1.0:1788837750.948724:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012763392 00000100:00100000:1.0:1788837750.948801:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:1.0:1788837750.948812:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+24:2395:x1875732012763392:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837750.948824:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837750.948842:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef3a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea67 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837750.948857:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889ad8ad9c00) 00010000:00010000:1.0:1788837750.948873:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837750.949124:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+23:2395:x1875732012763392:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 314us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837750.949132:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:2.0:1788837750.958834:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837750.965831:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012763520 00000100:00100000:3.0:1788837750.965850:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012763520 00000100:00100000:3.0:1788837750.965934:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:3.0:1788837750.965946:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+7:2393:x1875732012763520:12345-192.168.201.3@tcp:1:lfs.0 00010000:00010000:3.0:1788837750.966019:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef3c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.966042:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 7 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.966051:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837750.966056:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837750.966061:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef3c4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.966101:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 7 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837750.966117:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 7 pid: 8544 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837750.966132:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7f58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1875732036970112:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788837750.966428:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4e63a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837750.975404:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7f58e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1875732036970112:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788837750.975404:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00010000:00010000:3.0:1788837750.975443:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef3c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837750.976093:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012763648 00000100:00100000:2.0:1788837750.976102:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012763648 00002000:00100000:2.0:1788837750.976217:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff889affbdaa00 x1875732012763648/t0(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:406/0 lens 504/0 e 0 to 0 dl 1788837761 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788837750.976228:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889affbdaa00 with x1875732012763648 ext(0->12) 00010000:00010000:2.0:1788837750.976236:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 8 pid: 8544 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837750.976251:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 8 pid: 8544 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788837750.976259:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff889affbdaa00 00000100:00100000:2.0:1788837750.976342:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:2.0:1788837750.976352:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3a879e24-3b2f-4404-84c2-9101689d9315+8:2395:x1875732012763648:12345-192.168.201.3@tcp:4:lfs.0 00000001:00100000:0.0:1788837750.981489:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3a879e24-3b2f-4404-84c2-9101689d9315 00000100:00100000:2.0:1788837750.982532:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3a879e24-3b2f-4404-84c2-9101689d9315+9:2395:x1875732012763648:12345-192.168.201.3@tcp:4:lfs.0 Request processed in 6170us (7123us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788837750.982545:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00002000:00100000:2.0:1788837750.982558:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff889affbdaa00 x1875732012763648/t4294967300(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:406/0 lens 504/448 e 0 to 0 dl 1788837761 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788837750.982581:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889affbdaa00 with x1875732012763648 ext(0->12) 00010000:00010000:2.0:1788837750.982592:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 9 pid: 8544 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837750.982611:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 9 pid: 8544 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788837750.982619:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff889affbdaa00 00000100:00100000:1.0:1788837750.995415:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837751.001616:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012763776 00000100:00100000:2.0:1788837751.001634:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012763776 00010000:00010000:2.0:1788837751.001688:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 9 pid: 8544 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837751.001752:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:2.0:1788837751.001762:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+9:2393:x1875732012763776:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837751.001816:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788837751.001837:0:6510:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788837751.001840:0:6510:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788837751 00002000:00010000:2.0:1788837751.001842:0:6510:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788837751 00002000:00010000:2.0:1788837751.001845:0:6510:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788837751 00002000:00010000:2.0:1788837751.001847:0:6510:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788837751.001853:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 9 pid: 8544 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.001868:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 9 pid: 8544 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.001908:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068dfe92a/0x57f6d4e926aef377 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea52 expref: 9 pid: 8544 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.001925:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837751.001930:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837751.001936:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef3c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.001947:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef3c4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.002313:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef3c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.002336:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef3c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.002356:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef3c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.002365:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef3c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.002373:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef3c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.002380:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837751.002384:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef3c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.002393:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef3c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.002406:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef3c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.002414:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef3c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837751.002520:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+8:2393:x1875732012763520:12345-192.168.201.3@tcp:1:lfs.0 Request processed in 36576us (43745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837751.002529:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 31 00010000:00010000:2.0:1788837751.003655:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837751.003708:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+7:2393:x1875732012763776:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 1936us (8292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837751.003719:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:3.0:1788837751.004518:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837751.005259:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012764032 00000100:00100000:0.0:1788837751.005280:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012764032 00000100:00100000:0.0:1788837751.005334:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:0.0:1788837751.005345:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+23:11131:x1875732012764032:12345-192.168.201.3@tcp:35:lfs.0 00000004:00010000:0.0:1788837751.005404:0:6528:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef3b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea6e expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837751.005651:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788837751.005685:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:1.0:1788837751.012632:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00010000:00010000:1.0:1788837751.012726:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.012748:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef35b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea44 expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.012756:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.012829:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef35b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea44 expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.012849:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef35b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea44 expref: 27 pid: 6525 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837751.012865:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affbd9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1875732036970240:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788837751.012986:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f35cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837751.018661:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837751.018766:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012764160 00000100:00100000:2.0:1788837751.018805:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012764160 00010000:00010000:2.0:1788837751.018848:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef35b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea44 expref: 28 pid: 6525 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837751.018884:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:2.0:1788837751.018895:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+28:2396:x1875732012764160:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837751.018910:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837751.018917:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef35b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea44 expref: 28 pid: 6525 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.018944:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef35b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea44 expref: 28 pid: 6525 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.018966:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889ad8ad9c00) 00010000:00010000:2.0:1788837751.018972:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.018993:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.019001:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.019019:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837751.019076:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+28:2396:x1875732012764160:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 182us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837751.019084:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 54 00010000:00010000:3.0:1788837751.019564:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef35b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea44 expref: 27 pid: 6525 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837751.019584:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affbd9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1875732036970240:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837751.019604:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.019613:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.019619:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837751.019733:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000001:00080000:3.0:1788837751.019878:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1788837751.019973:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7f59f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875732036970368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788837751.020310:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837751.020340:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4e63240 going to sleep for 11 seconds 00000100:00100000:2.0:1788837751.020430:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036970368 00000100:00100000:2.0:1788837751.020436:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036970368 00000100:00100000:2.0:1788837751.020500:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788837751.020509:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6528:x1875732036970368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788837751.020586:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6528:x1875732036970368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 78us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837751.020594:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788837751.021101:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837751.021131:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7f59f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875732036970368:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788837751.021314:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:3.0:1788837751.021369:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7f59f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875732036970496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788837751.021419:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837751.021441:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4e63900 going to sleep for 11 seconds 00000100:00100000:2.0:1788837751.022736:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036970496 00000100:00100000:2.0:1788837751.022747:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036970496 00000100:00100000:2.0:1788837751.022813:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788837751.022822:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1875732036970496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788837751.022992:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6528:x1875732036970496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 170us (1571us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788837751.022999:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788837751.023340:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7f59f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875732036970496:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788837751.023396:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1788837751.023435:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.023445:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.023452:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.023457:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837751.023461:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.023468:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.023494:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889ad8ad9c00) 00010000:00010000:3.0:1788837751.023497:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788837751.023502:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837751.023507:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef3cb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837751.023607:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788837751.023664:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788837751.023676:0:6528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367894898602ns, next at 368894896577ns, rc = 0 00000001:00080000:3.0:1788837751.023690:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967327 00010000:00010000:3.0:1788837751.023715:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889ad8ad9c00) 00010000:00010000:3.0:1788837751.023718:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788837751.023725:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef3b6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea6e expref: 31 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837751.023948:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+30:11131:x1875732012764032:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 18605us (19433us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788837751.023957:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00000020:00080000:3.0:1788837751.023961:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788837751.026420:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837751.026965:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012764288 00000100:00100000:2.0:1788837751.026975:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012764288 00000100:00100000:2.0:1788837751.027036:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:2.0:1788837751.027045:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+30:11131:x1875732012764288:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837751.027068:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837751.027090:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef3d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea75 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.027320:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea75 expref: 31 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.027336:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea75 expref: 31 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.027355:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:2.0:1788837751.027358:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837751.027361:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6daa00, rc 0) 00000100:00100000:2.0:1788837751.027418:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+31:11131:x1875732012764288:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 374us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837751.027425:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:2.0:1788837751.035730:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837751.035884:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012764544 00000100:00100000:0.0:1788837751.035894:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012764544 00000100:00100000:0.0:1788837751.035961:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:0.0:1788837751.035972:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8e78c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+31:11131:x1875732012764544:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:0.0:1788837751.036371:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8e78c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+32:11131:x1875732012764544:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 399us (648us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788837751.036380:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:3.0:1788837751.157525:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837751.157725:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012764800 00000100:00100000:1.0:1788837751.157735:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012764800 00000100:00100000:1.0:1788837751.157838:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:1.0:1788837751.157849:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+32:11141:x1875732012764800:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788837751.157893:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837751.157916:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef3d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea7c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837751.158037:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788837751.158152:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef3d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea7c expref: 34 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.158167:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ad8ad9400) 00010000:00010000:1.0:1788837751.158170:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837751.158175:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef3d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea7c expref: 34 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.158190:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9000, rc 0) 00000100:00100000:1.0:1788837751.158261:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+33:11141:x1875732012764800:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 413us (747us total) trans 4294967330 rc 301/301 00000100:00100000:1.0:1788837751.158286:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:2.0:1788837751.162507:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837751.162677:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012764928 00000100:00100000:0.0:1788837751.162688:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012764928 00000100:00100000:0.0:1788837751.162749:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:0.0:1788837751.162760:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+33:11141:x1875732012764928:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:0.0:1788837751.162884:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef3e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.162903:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef3e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.162918:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef3e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.162930:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef3ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.162938:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef3ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.162944:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef3ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163228:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef3f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163238:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163245:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837751.163310:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163326:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef3e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163334:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef3e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163341:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef3e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163348:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837751.163352:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef3e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163360:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef3e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163371:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:0.0:1788837751.163375:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837751.163379:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef3e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163393:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef3e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163407:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef3ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163413:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef3ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163419:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef3ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163424:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837751.163427:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef3ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163433:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef3ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163442:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889ad8ad9000) 00010000:00010000:0.0:1788837751.163444:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837751.163447:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef3ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163453:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef3ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163462:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163467:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef3f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163479:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163484:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837751.163486:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163492:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef3f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163499:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:0.0:1788837751.163501:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837751.163504:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef3f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.163509:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef3f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837751.163587:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+33:11141:x1875732012764928:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 827us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837751.163595:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:3.0:1788837751.167618:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837751.170153:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012765184 00000100:00100000:0.0:1788837751.170170:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012765184 00000100:00100000:0.0:1788837751.170241:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:0.0:1788837751.170251:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+33:11141:x1875732012765184:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:0.0:1788837751.170498:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+34:11141:x1875732012765184:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 247us (3170us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788837751.170507:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:2.0:1788837751.225257:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7f58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036970624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837751.225362:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837751.225476:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837751.225483:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036970752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837751.225509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837751.230085:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036970624 00000100:00100000:0.0:1788837751.230098:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036970624 00000100:00100000:0.0:1788837751.230198:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036970752 00000100:00100000:0.0:1788837751.230202:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036970752 00000100:00100000:1.0:1788837751.231190:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788837751.231208:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036970624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837751.231243:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837751.231346:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036970624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (5984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837751.231354:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788837751.231416:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7f58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036970624:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788837751.234399:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837751.234851:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788837751.234864:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036970752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837751.234904:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837751.235228:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036970752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 366us (9717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837751.235236:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788837751.235444:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036970752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837751.255362:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837751.255581:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012765440 00000100:00100000:1.0:1788837751.255593:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012765440 00000100:00100000:1.0:1788837751.255675:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:1.0:1788837751.255685:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+34:11144:x1875732012765440:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788837751.255711:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837751.255733:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef3fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea83 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257213:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef403 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257234:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef403 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257247:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef403 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257260:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef40a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257297:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef40a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257305:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef40a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257415:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef411 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257424:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257431:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837751.257455:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788837751.257532:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef403 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257539:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef403 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257545:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef403 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257550:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837751.257554:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef403 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257561:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef403 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257574:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:1.0:1788837751.257577:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837751.257582:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef403 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257588:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef403 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257600:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef40a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257606:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef40a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257622:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef40a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257627:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837751.257630:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef40a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257635:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef40a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257642:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889ad8ad9000) 00010000:00010000:1.0:1788837751.257645:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837751.257647:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef40a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257652:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef40a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257696:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef3fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea83 expref: 37 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257709:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef411 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea83 expref: 36 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.257715:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:1.0:1788837751.257717:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837751.257720:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9600, rc 0) 00000100:00100000:1.0:1788837751.258418:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+36:11144:x1875732012765440:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 2729us (3061us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788837751.258439:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:2.0:1788837751.263922:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837751.264253:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012765568 00000100:00100000:0.0:1788837751.264262:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012765568 00000100:00100000:0.0:1788837751.264331:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:0.0:1788837751.264343:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+36:11144:x1875732012765568:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:0.0:1788837751.264407:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef41f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.264421:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef41f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.264429:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef41f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.264456:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef41f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.264461:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef41f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.264465:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef41f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.264481:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837751.264485:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef41f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.264490:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef41f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.264498:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:0.0:1788837751.264500:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837751.264503:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef41f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.264507:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef41f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837751.264563:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+36:11144:x1875732012765568:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 224us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837751.264568:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:3.0:1788837751.266831:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837751.266906:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012765824 00000100:00100000:0.0:1788837751.266916:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012765824 00000100:00100000:0.0:1788837751.266963:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:0.0:1788837751.266983:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+36:11144:x1875732012765824:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:0.0:1788837751.267238:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+37:11144:x1875732012765824:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 266us (416us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788837751.267246:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00010000:00010000:2.0:1788837751.483744:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837751.593232:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837751.593372:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012766080 00000100:00100000:1.0:1788837751.593384:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012766080 00000100:00100000:1.0:1788837751.593459:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:1.0:1788837751.593471:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+37:11175:x1875732012766080:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:1.0:1788837751.593496:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837751.593520:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef426 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea8a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.593651:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef42d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.593668:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef42d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.593682:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef42d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837751.593693:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788837751.594068:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef426 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea8a expref: 40 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.594088:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef42d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea8a expref: 39 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.594096:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:1.0:1788837751.594099:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837751.594102:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9a00, rc 0) 00000100:00100000:1.0:1788837751.594298:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+39:11175:x1875732012766080:12345-192.168.201.3@tcp:101:cat.0 Request processed in 829us (1079us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1788837751.594306:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:3.0:1788837751.599450:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837751.599538:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012766208 00000100:00100000:1.0:1788837751.599549:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012766208 00000100:00100000:1.0:1788837751.599625:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:1.0:1788837751.599635:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+39:2394:x1875732012766208:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837751.599654:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837751.599681:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef42d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea8a expref: 39 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.599704:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:1.0:1788837751.599709:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837751.599822:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+38:2394:x1875732012766208:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 188us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837751.599830:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:2.0:1788837751.600474:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837751.600530:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012766464 00000100:00100000:0.0:1788837751.600535:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012766464 00000100:00100000:0.0:1788837751.600572:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:0.0:1788837751.600595:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+38:11175:x1875732012766464:12345-192.168.201.3@tcp:35:cat.0 00000100:00100000:0.0:1788837751.600832:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+39:11175:x1875732012766464:12345-192.168.201.3@tcp:35:cat.0 Request processed in 237us (359us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788837751.600839:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:3.0:1788837751.681672:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837751.681810:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012766720 00000100:00100000:0.0:1788837751.681821:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012766720 00000100:00100000:2.0:1788837751.682070:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:2.0:1788837751.682084:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+39:11181:x1875732012766720:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:2.0:1788837751.682112:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837751.682116:0:9317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788837751.682155:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef393 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea60 expref: 39 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.682176:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:2.0:1788837751.682182:0:9317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837751.682196:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef43b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea91 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.682317:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.682331:0:9317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef411 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea83 expref: 39 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.682340:0:9317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.682384:0:9317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef411 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea83 expref: 39 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.682397:0:9317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef411 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea83 expref: 39 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837751.682412:0:9317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2650000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036970880:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837751.682525:0:9317:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adeb73780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837751.686415:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837751.687092:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012766848 00000100:00100000:0.0:1788837751.687114:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012766848 00010000:00010000:0.0:1788837751.687157:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef411 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea83 expref: 40 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837751.687215:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:0.0:1788837751.687226:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac4409180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+40:2396:x1875732012766848:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837751.687242:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837751.687250:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef411 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea83 expref: 40 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.687274:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef411 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea83 expref: 40 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.687300:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:0.0:1788837751.687307:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.687316:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.687324:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.687360:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837751.687421:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac4409180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+40:2396:x1875732012766848:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 197us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837751.687430:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 55 00010000:00010000:2.0:1788837751.690902:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef411 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea83 expref: 39 pid: 6525 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837751.691023:0:9317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2650000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036970880:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837751.691053:0:9317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.691064:0:9317:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.691070:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837751.691092:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788837751.693122:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef43b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea91 expref: 40 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.693148:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea91 expref: 39 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837751.693177:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:2.0:1788837751.693180:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788837751.693184:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6db400, rc 0) 00000100:00100000:2.0:1788837751.693290:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+39:11181:x1875732012766720:12345-192.168.201.3@tcp:101:dd.0 Request processed in 11180us (11600us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788837751.693301:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:3.0:1788837751.699362:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837751.699585:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012766976 00000100:00100000:1.0:1788837751.699598:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012766976 00000100:00100000:1.0:1788837751.699676:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:1.0:1788837751.699697:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac440a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+39:11181:x1875732012766976:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:1.0:1788837751.701310:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837751.701340:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef450 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea98 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.701381:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef457 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.701396:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef457 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.701423:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef457 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.701549:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef450 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea98 expref: 41 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.701569:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef457 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea98 expref: 40 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837751.701578:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:1.0:1788837751.701581:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788837751.701585:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9000, rc 0) 00000100:00100000:1.0:1788837751.701844:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac440a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+40:11181:x1875732012766976:12345-192.168.201.3@tcp:101:dd.0 Request processed in 2157us (2491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837751.701853:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:2.0:1788837751.718406:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837751.718632:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012767232 00000100:00100000:0.0:1788837751.718829:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012767232 00000100:00100000:0.0:1788837751.719088:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:0.0:1788837751.719098:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+40:11181:x1875732012767232:12345-192.168.201.3@tcp:36:dd.0 00010000:00010000:0.0:1788837751.719345:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef45e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.719365:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef45e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.719379:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef45e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837751.719422:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788837751.719446:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e90d5ed reply state 00000000ddc8063d transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef45e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.719458:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef45e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837751.719479:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:0.0:1788837751.719481:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788837751.719485:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837751.719797:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+43:11181:x1875732012767232:12345-192.168.201.3@tcp:36:dd.0 Request processed in 615us (1315us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788837751.719825:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 62 00000020:00080000:0.0:1788837751.719831:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788837752.060591:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837752.060695:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012767360 00000100:00100000:1.0:1788837752.060706:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012767360 00000100:00100000:1.0:1788837752.060832:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:1.0:1788837752.060841:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac440bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+43:11195:x1875732012767360:12345-192.168.201.3@tcp:101:stat.0 00010000:00010000:1.0:1788837752.060864:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837752.060893:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef465 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ea9f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.060960:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef46c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.060972:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef46c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.060991:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef46c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.061000:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef473 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.061005:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef473 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.061009:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef473 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.061080:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef47a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.061087:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea91 expref: 44 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.061093:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef47a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.061124:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea91 expref: 44 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.061136:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea91 expref: 44 pid: 9317 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837752.061146:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affbdbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036971008:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788837752.061273:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f35840 going to sleep for 11 seconds 00000100:00080000:2.0:1788837752.061382:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837752.065923:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837752.066111:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affbdbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036971008:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788837752.066143:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef47a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837752.071492:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012767616 00000100:00100000:0.0:1788837752.071510:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012767616 00000100:00100000:0.0:1788837752.071593:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:0.0:1788837752.071604:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac4409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+45:6165:x1875732012767616:12345-192.168.201.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788837752.071978:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac4409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+46:6165:x1875732012767616:12345-192.168.201.3@tcp:35:ldlm_bl.0 Request processed in 375us (6066us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1788837752.071986:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:0.0:1788837752.076810:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837752.077319:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012767744 00000100:00100000:1.0:1788837752.077328:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012767744 00010000:00010000:1.0:1788837752.077367:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea91 expref: 46 pid: 9317 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837752.077466:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:1.0:1788837752.077476:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+46:2395:x1875732012767744:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837752.077491:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837752.077498:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea91 expref: 46 pid: 9317 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.077512:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea91 expref: 46 pid: 9317 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.077535:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef442 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea91 expref: 46 pid: 9317 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.077550:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:1.0:1788837752.077555:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef47a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.077565:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef47a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.077571:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef47a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.077621:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837752.077756:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+45:2395:x1875732012767744:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 281us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837752.077764:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 56 00010000:00010000:3.0:1788837752.077873:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef47a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.077882:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef47a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837752.077934:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788837752.077939:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837752.077988:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef47a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078002:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef47a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078012:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef46c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078018:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef46c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078023:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef46c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078029:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837752.078032:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef46c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078040:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef46c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078048:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:3.0:1788837752.078051:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837752.078055:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef46c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078061:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef46c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078072:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef473 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078078:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef473 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078089:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef473 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078094:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837752.078098:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef473 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078104:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef473 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078112:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889ad8ad9000) 00010000:00010000:3.0:1788837752.078115:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837752.078118:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef473 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078123:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef473 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078155:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef465 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea9f expref: 45 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078169:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef47a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea9f expref: 44 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.078175:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:3.0:1788837752.078177:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837752.078952:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8800, rc 0) 00000100:00100000:3.0:1788837752.079002:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac440bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+44:11195:x1875732012767360:12345-192.168.201.3@tcp:101:stat.0 Request processed in 18161us (18419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837752.079021:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:0.0:1788837752.154034:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837752.154196:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012768000 00000100:00100000:2.0:1788837752.154207:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012768000 00000100:00100000:2.0:1788837752.154332:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:2.0:1788837752.154346:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+44:11201:x1875732012768000:12345-192.168.201.3@tcp:36:truncate.0 00010000:00010000:2.0:1788837752.154632:0:9317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837752.154665:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef47a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea9f expref: 44 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.154685:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:2.0:1788837752.154689:0:9317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837752.155431:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef481 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.155654:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.155664:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837752.157062:0:9317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967340 00000004:00010000:2.0:1788837752.157449:0:9317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000335aa75d reply state 00000000028a882c transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef481 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.157560:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef481 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.157569:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:2.0:1788837752.157571:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788837752.157575:0:9317:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837752.157798:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+46:11201:x1875732012768000:12345-192.168.201.3@tcp:36:truncate.0 Request processed in 3429us (3753us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788837752.159688:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 64 00000020:00080000:2.0:1788837752.159699:0:9317:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788837752.288428:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837752.288519:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012768128 00000100:00100000:3.0:1788837752.288528:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012768128 00000100:00100000:3.0:1788837752.288600:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:3.0:1788837752.288610:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+46:11215:x1875732012768128:12345-192.168.201.3@tcp:101:stat.0 00010000:00010000:3.0:1788837752.288640:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837752.288662:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef488 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eaa6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288736:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef48f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288748:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef48f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288756:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef48f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288764:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef496 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288769:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288772:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288873:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef49d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288894:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef49d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288899:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef49d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837752.288937:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788837752.288941:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837752.288960:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef49d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288969:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef49d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288975:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef48f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288979:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef48f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288983:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef48f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288987:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837752.288990:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef48f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.288995:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef48f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.289004:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:3.0:1788837752.289010:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837752.289014:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef48f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.289018:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef48f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.289028:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef496 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.289031:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef496 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.289035:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.289037:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837752.289039:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef496 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.289042:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef496 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.289046:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889ad8ad9000) 00010000:00010000:3.0:1788837752.289047:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837752.289049:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef496 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.289052:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef496 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.289069:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef488 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eaa6 expref: 48 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.289086:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef49d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eaa6 expref: 47 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.289091:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:3.0:1788837752.289093:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837752.289094:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16800, rc 0) 00000100:00100000:3.0:1788837752.289150:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+47:11215:x1875732012768128:12345-192.168.201.3@tcp:101:stat.0 Request processed in 542us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837752.289161:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 65 00000040:00080000:3.0:1788837752.315437:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788837752.378520:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788837752.402871:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837752.402959:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012768384 00000100:00100000:1.0:1788837752.402968:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012768384 00000100:00100000:1.0:1788837752.403018:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:1.0:1788837752.403028:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+47:11225:x1875732012768384:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788837752.403050:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837752.403073:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef4a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eaad expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837752.403157:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788837752.403258:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef4a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eaad expref: 49 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.403274:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ad8ad9400) 00010000:00010000:1.0:1788837752.403277:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837752.403282:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef4a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eaad expref: 49 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.403296:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8800, rc 0) 00000100:00100000:1.0:1788837752.403358:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+48:11225:x1875732012768384:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 331us (498us total) trans 4294967342 rc 301/301 00000100:00100000:1.0:1788837752.403366:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:0.0:1788837752.410156:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837752.410386:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012768640 00000100:00100000:3.0:1788837752.410397:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012768640 00000100:00100000:3.0:1788837752.410502:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:3.0:1788837752.410516:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+48:11225:x1875732012768640:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:3.0:1788837752.412128:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+49:11225:x1875732012768640:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 1606us (1976us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788837752.412142:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:0.0:1788837752.501394:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837752.501498:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012768896 00000100:00100000:3.0:1788837752.501508:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012768896 00000100:00100000:3.0:1788837752.501575:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:3.0:1788837752.501586:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+49:11231:x1875732012768896:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788837752.501615:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837752.501636:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef4b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eab4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.501772:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.501833:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef49d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eaa6 expref: 50 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.501842:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.501892:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef49d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eaa6 expref: 50 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.501907:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef49d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eaa6 expref: 50 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837752.501923:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac4409500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875732036971136:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788837752.502033:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4e63d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837752.506380:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00010000:00010000:1.0:1788837752.506472:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837752.506659:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012769024 00000100:00100000:0.0:1788837752.506670:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012769024 00010000:00010000:0.0:1788837752.506717:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef49d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eaa6 expref: 51 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837752.506765:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:0.0:1788837752.506802:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8563050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+51:2395:x1875732012769024:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837752.506818:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837752.506826:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef49d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eaa6 expref: 51 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837752.506856:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef49d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eaa6 expref: 51 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837752.506890:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:0.0:1788837752.506895:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837752.506906:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837752.506918:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837752.506940:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837752.507020:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8563050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+51:2395:x1875732012769024:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 245us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837752.507028:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 57 00010000:00010000:3.0:1788837752.508461:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef49d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eaa6 expref: 50 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837752.508480:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac4409500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875732036971136:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837752.508500:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.508508:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.508530:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837752.508551:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788837752.508711:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef4b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eab4 expref: 51 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.508724:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eab4 expref: 50 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.508730:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:3.0:1788837752.508732:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788837752.508735:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17e00, rc 0) 00000100:00100000:3.0:1788837752.508956:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+50:11231:x1875732012768896:12345-192.168.201.3@tcp:101:bash.0 Request processed in 7370us (7570us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788837752.508963:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:3.0:1788837752.512773:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837752.512855:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012769280 00000100:00100000:2.0:1788837752.512867:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012769280 00000100:00100000:2.0:1788837752.512933:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:2.0:1788837752.512943:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac4409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+50:11231:x1875732012769280:12345-192.168.201.3@tcp:36:bash.0 00010000:00010000:2.0:1788837752.513202:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926aef4c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.513219:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926aef4c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.513231:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926aef4c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837752.513287:0:9317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967345 00000004:00010000:2.0:1788837752.513328:0:9317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6128c38 reply state 000000004e559c7e transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926aef4c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.513341:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926aef4c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.513349:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:2.0:1788837752.513351:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788837752.513355:0:9317:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837752.513455:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac4409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+53:11231:x1875732012769280:12345-192.168.201.3@tcp:36:bash.0 Request processed in 512us (694us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788837752.513462:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 68 00000020:00080000:2.0:1788837752.513468:0:9317:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788837752.520513:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837752.520618:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012769408 00000100:00100000:1.0:1788837752.520630:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012769408 00000100:00100000:1.0:1788837752.520703:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:1.0:1788837752.520713:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+53:11231:x1875732012769408:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788837752.520739:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837752.520762:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef4ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eabb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.520896:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef4d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.520914:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eab4 expref: 54 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.520923:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef4d5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.520958:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eab4 expref: 54 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.520973:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eab4 expref: 54 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837752.520987:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affbdbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036971264:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788837752.521066:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f35840 going to sleep for 11 seconds 00000100:00100000:1.0:1788837752.526568:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affbdbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036971264:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788837752.526614:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef4d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837752.528663:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837752.530025:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012769536 00000100:00100000:2.0:1788837752.530043:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012769536 00010000:00010000:2.0:1788837752.530266:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eab4 expref: 55 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837752.530368:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:2.0:1788837752.530379:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+55:2396:x1875732012769536:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837752.530397:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837752.530405:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eab4 expref: 55 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.530429:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eab4 expref: 55 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.530463:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef4b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eab4 expref: 55 pid: 6526 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.530501:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:2.0:1788837752.530506:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef4d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.530516:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef4d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.530525:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef4d5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.530566:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837752.530653:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+54:2396:x1875732012769536:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 276us (2229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837752.530661:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 58 00010000:00010000:3.0:1788837752.530734:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef4d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.530743:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef4d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837752.530822:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788837752.530827:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837752.530851:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef4d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.530885:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef4ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eabb expref: 54 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.530912:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef4d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eabb expref: 53 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.530919:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:3.0:1788837752.530922:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837752.530924:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8c00, rc 0) 00000100:00100000:3.0:1788837752.530953:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+53:11231:x1875732012769408:12345-192.168.201.3@tcp:101:bash.0 Request processed in 10242us (10449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837752.530961:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:0.0:1788837752.536750:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837752.536994:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012769792 00000100:00100000:3.0:1788837752.537005:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012769792 00000100:00100000:3.0:1788837752.537107:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:3.0:1788837752.537118:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8e7a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+53:11231:x1875732012769792:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:3.0:1788837752.537547:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8e7a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+54:11231:x1875732012769792:12345-192.168.201.3@tcp:35:bash.0 Request processed in 430us (808us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788837752.537557:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:0.0:1788837752.637016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837752.637554:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012770048 00000100:00100000:2.0:1788837752.637568:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012770048 00000100:00100000:2.0:1788837752.637657:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 70 00000100:00100000:2.0:1788837752.637881:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+54:11241:x1875732012770048:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837752.637908:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837752.637931:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef4dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eac2 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837752.638043:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788837752.638834:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef4dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eac2 expref: 56 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.638853:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ad8ad9400) 00010000:00010000:2.0:1788837752.638873:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837752.638880:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef4dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eac2 expref: 56 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.638897:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6dae00, rc 0) 00000100:00100000:2.0:1788837752.639023:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+55:11241:x1875732012770048:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 1356us (2025us total) trans 4294967348 rc 301/301 00000100:00100000:2.0:1788837752.639031:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 70 00000100:00100000:0.0:1788837752.650425:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837752.650953:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012770176 00000100:00100000:3.0:1788837752.650965:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012770176 00000100:00100000:3.0:1788837752.651091:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 71 00000100:00100000:3.0:1788837752.651103:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+55:11241:x1875732012770176:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:3.0:1788837752.651327:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef4ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651345:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef4ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651380:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef4ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651393:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef4f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651402:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651409:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651622:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef4f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651635:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651642:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837752.651710:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651723:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef4ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651729:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef4ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651737:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef4ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651754:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837752.651759:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef4ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651766:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef4ea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651806:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:3.0:1788837752.651810:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837752.651815:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef4ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651821:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef4ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651836:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651842:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef4f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651848:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef4f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651852:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837752.651855:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef4f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651860:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef4f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651879:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889ad8ad9000) 00010000:00010000:3.0:1788837752.651882:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837752.651885:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef4f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651890:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef4f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651900:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651905:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef4f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651910:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef4f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651914:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837752.651917:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef4f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651922:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef4f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651928:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:3.0:1788837752.651930:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837752.651933:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef4f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837752.651937:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef4f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837752.652043:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+55:11241:x1875732012770176:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 941us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837752.652051:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 71 00000100:00100000:0.0:1788837752.655902:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837752.656036:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012770432 00000100:00100000:2.0:1788837752.656047:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012770432 00000100:00100000:2.0:1788837752.656145:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:2.0:1788837752.656163:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+55:11241:x1875732012770432:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788837752.656471:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+56:11241:x1875732012770432:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 310us (579us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788837752.656480:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:0.0:1788837752.693924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837752.694046:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012770688 00000100:00100000:1.0:1788837752.694057:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012770688 00000100:00100000:1.0:1788837752.694341:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:1.0:1788837752.694353:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+56:11244:x1875732012770688:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788837752.694382:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837752.694405:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef4ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eac9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694504:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef506 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694519:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef506 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694531:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef506 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694541:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef50d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694548:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef50d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694553:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef50d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694682:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef514 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694689:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694712:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837752.694721:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788837752.694812:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef506 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694818:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef506 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694823:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef506 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694826:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837752.694830:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef506 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694835:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef506 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694844:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:1.0:1788837752.694846:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837752.694849:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef506 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694852:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef506 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694861:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef50d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694864:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef50d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694873:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef50d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694876:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837752.694878:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef50d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694881:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef50d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694885:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889ad8ad9000) 00010000:00010000:1.0:1788837752.694886:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837752.694888:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef50d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694891:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef50d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694919:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef4ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eac9 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694927:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef514 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eac9 expref: 58 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.694931:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:1.0:1788837752.694933:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837752.694934:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9a00, rc 0) 00000100:00100000:1.0:1788837752.695025:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+58:11244:x1875732012770688:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 676us (1111us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788837752.695037:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:0.0:1788837752.697968:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837752.697997:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837752.698049:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012770816 00000100:00100000:1.0:1788837752.698058:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012770816 00000100:00100000:1.0:1788837752.698117:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:1.0:1788837752.698126:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+58:2394:x1875732012770816:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837752.698141:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837752.698322:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aef514 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eac9 expref: 58 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.698338:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:1.0:1788837752.698342:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837752.698405:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+57:2394:x1875732012770816:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 280us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837752.698412:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:2.0:1788837752.698812:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012770944 00000100:00100000:2.0:1788837752.698820:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012770944 00000100:00100000:2.0:1788837752.698845:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 73 00000100:00100000:2.0:1788837752.698849:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+57:11244:x1875732012770944:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:2.0:1788837752.698895:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef522 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.698907:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef522 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.698914:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef522 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.698957:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef522 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.698964:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef522 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.698970:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef522 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.698976:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dae00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837752.698980:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef522 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.698987:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef522 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.698997:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:2.0:1788837752.698999:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788837752.699003:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef522 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.699009:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef522 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837752.699059:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+57:11244:x1875732012770944:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 208us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837752.699064:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 73 00000100:00100000:0.0:1788837752.705863:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837752.705947:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012771200 00000100:00100000:3.0:1788837752.705957:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012771200 00000100:00100000:3.0:1788837752.706017:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:3.0:1788837752.706029:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+57:11244:x1875732012771200:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:3.0:1788837752.706677:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+58:11244:x1875732012771200:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 649us (827us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788837752.706683:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:3.0:1788837752.766652:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac4409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036971392:0@lo:400:kworker.0 00000100:00100000:3.0:1788837752.766729:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837752.766827:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036971904:0@lo:400:kworker.0 00000100:00100000:3.0:1788837752.766858:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837752.766876:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad1161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036972416:0@lo:400:kworker.0 00000100:00100000:3.0:1788837752.766899:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837752.766914:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad1163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036972928:0@lo:400:kworker.0 00000100:00100000:3.0:1788837752.766932:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837752.766952:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788837752.766958:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac440b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036971520:0@lo:400:kworker.0 00000100:00100000:3.0:1788837752.766981:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837752.766996:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036972032:0@lo:400:kworker.0 00000100:00100000:3.0:1788837752.767070:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837752.767096:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad1160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036972544:0@lo:400:kworker.0 00000100:00100000:3.0:1788837752.767117:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837752.767146:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036971392 00000100:00100000:3.0:1788837752.767153:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036971392 00000100:00100000:3.0:1788837752.767200:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788837752.767209:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3650:x1875732036971392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837752.767276:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3650:x1875732036971392:12345-0@lo:400:kworker.0 Request processed in 68us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837752.767283:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788837752.767395:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036971776:0@lo:400:kworker.0 00000100:00100000:3.0:1788837752.767423:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837752.767441:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036972288:0@lo:400:kworker.0 00000100:00100000:3.0:1788837752.767462:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837752.767477:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad1160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036972800:0@lo:400:kworker.0 00000100:00100000:3.0:1788837752.767497:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837752.767516:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788837752.767522:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac4409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036971648:0@lo:400:kworker.0 00000100:00100000:3.0:1788837752.767545:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837752.767559:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732036972160:0@lo:400:kworker.0 00000100:00100000:3.0:1788837752.767579:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837752.767589:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad1160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732036972672:0@lo:400:kworker.0 00000100:00100000:3.0:1788837752.767608:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837752.767705:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac4409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036971392:0@lo:400:kworker.0 00000004:00080000:2.0:1788837752.767965:0:9993:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 369639187631ns, next at 370639185311ns, rc = 0 00000100:00100000:2.0:1788837752.767990:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036971904 00000100:00100000:2.0:1788837752.767995:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036971904 00000100:00100000:2.0:1788837752.768031:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036971648 00000100:00100000:2.0:1788837752.768035:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036971648 00000100:00100000:2.0:1788837752.768049:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788837752.768056:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036971904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.768101:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036971904:12345-0@lo:400:kworker.0 Request processed in 46us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837752.768107:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788837752.768121:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788837752.768126:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036971648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.768159:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036971648:12345-0@lo:400:kworker.0 Request processed in 32us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837752.768166:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788837752.768197:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac4409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036971648:0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.768220:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036971904:0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.768228:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837752.768235:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036973056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837752.768285:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837752.768311:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036971520 00000100:00100000:2.0:1788837752.768315:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036971520 00000100:00100000:2.0:1788837752.768333:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036972032 00000100:00100000:2.0:1788837752.768336:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036972032 00000100:00080000:2.0:1788837752.768357:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837752.768373:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036972544 00000100:00100000:2.0:1788837752.768376:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036972544 00000100:00080000:2.0:1788837752.768389:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837752.768401:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036971776 00000100:00100000:2.0:1788837752.768404:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036971776 00000100:00100000:2.0:1788837752.768414:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036972160 00000100:00100000:2.0:1788837752.768423:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036972160 00000100:00080000:2.0:1788837752.768436:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837752.768451:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036972672 00000100:00100000:2.0:1788837752.768453:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036972672 00000100:00080000:2.0:1788837752.768464:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837752.768478:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788837752.768483:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036971520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.768521:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036971520:12345-0@lo:400:kworker.0 Request processed in 38us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837752.768528:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788837752.768553:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac440b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036971520:0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.768570:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788837752.768576:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036972032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.768625:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036972032:12345-0@lo:400:kworker.0 Request processed in 49us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837752.768631:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788837752.768654:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036972032:0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.768671:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788837752.768677:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036972544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.768710:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036972544:12345-0@lo:400:kworker.0 Request processed in 34us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837752.768716:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788837752.768739:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad1160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036972544:0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.768756:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788837752.768763:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036971776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.768836:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036971776:12345-0@lo:400:kworker.0 Request processed in 73us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837752.768842:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788837752.768867:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036971776:0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.768885:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788837752.768893:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732036972160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.768926:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732036972160:12345-0@lo:400:kworker.0 Request processed in 36us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837752.768932:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00010000:00080000:2.0:1788837752.768954:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3344a80 x1875732036972160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837752.768964:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732036972160:0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.768979:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788837752.768984:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732036972672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837752.769014:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732036972672:12345-0@lo:400:kworker.0 Request processed in 31us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837752.769020:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00080000:2.0:1788837752.769040:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ad1160700 x1875732036972672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837752.769048:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad1160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732036972672:0@lo:400:kworker.0 00000100:00100000:1.0:1788837752.769426:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036972416 00000100:00100000:1.0:1788837752.769432:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036972416 00000100:00100000:1.0:1788837752.769474:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036972928 00000100:00100000:1.0:1788837752.769477:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036972928 00000100:00100000:1.0:1788837752.769490:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036972288 00000100:00100000:1.0:1788837752.769493:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036972288 00000100:00100000:1.0:1788837752.769504:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036972800 00000100:00100000:1.0:1788837752.769508:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036972800 00000100:00100000:1.0:1788837752.769544:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788837752.769550:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036972416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837752.769596:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036972416:12345-0@lo:400:kworker.0 Request processed in 47us (2697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837752.769602:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788837752.769624:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788837752.769630:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036972928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837752.769661:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036972928:12345-0@lo:400:kworker.0 Request processed in 31us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837752.769667:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788837752.769680:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788837752.769685:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036972288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837752.769719:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036972288:12345-0@lo:400:kworker.0 Request processed in 34us (2255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837752.769724:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788837752.769736:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788837752.769742:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036972800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837752.769769:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036972800:12345-0@lo:400:kworker.0 Request processed in 27us (2270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837752.769792:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1788837752.769809:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837752.769831:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036973056 00000100:00100000:1.0:1788837752.769835:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036973056 00000100:00100000:1.0:1788837752.769860:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788837752.769866:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036973056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837752.769888:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788837752.769922:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036973056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837752.769928:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788837752.769966:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036972288:0@lo:400:kworker.0 00000100:00100000:1.0:1788837752.769979:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad1160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036972800:0@lo:400:kworker.0 00000100:00100000:1.0:1788837752.770029:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036973056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837752.770040:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad1161c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036972416:0@lo:400:kworker.0 00000100:00100000:1.0:1788837752.770048:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad1163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036972928:0@lo:400:kworker.0 00000100:00100000:0.0:1788837752.771027:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036973184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837752.771100:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837752.771312:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036973184 00000100:00100000:2.0:1788837752.771319:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036973184 00000100:00100000:2.0:1788837752.771367:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788837752.771376:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036973184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788837752.771413:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788837752.772868:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036973184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1490us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837752.772877:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788837752.773945:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036973184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837752.773985:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837752.773994:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad1162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036973312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837752.774041:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837752.774302:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036973312 00000100:00100000:2.0:1788837752.774309:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036973312 00000100:00100000:2.0:1788837752.774359:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788837752.774369:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036973312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837752.774388:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788837752.775951:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036973312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1574us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837752.775962:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788837752.776308:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad1162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036973312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837752.899938:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837752.900058:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012771456 00000100:00100000:2.0:1788837752.900072:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012771456 00000100:00100000:2.0:1788837752.900168:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 74 00000100:00100000:2.0:1788837752.900186:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+58:11262:x1875732012771456:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:2.0:1788837752.900213:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837752.900245:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef529 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ead0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.900369:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef530 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.900385:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef530 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.900397:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef530 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837752.900439:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788837752.900730:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef529 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ead0 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.900749:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef530 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ead0 expref: 60 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.900759:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:2.0:1788837752.900761:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788837752.900765:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6db400, rc 0) 00000100:00100000:2.0:1788837752.900959:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+60:11262:x1875732012771456:12345-192.168.201.3@tcp:101:cat.0 Request processed in 781us (1031us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788837752.900968:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 74 00000100:00100000:0.0:1788837752.927075:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837752.927169:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012771584 00000100:00100000:1.0:1788837752.927177:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012771584 00000100:00100000:1.0:1788837752.927273:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 75 00000100:00100000:1.0:1788837752.927282:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+60:11263:x1875732012771584:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788837752.927314:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837752.927335:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef53e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ead7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.927389:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef545 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.927407:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.927416:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837752.927461:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788837752.927463:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837752.927478:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef545 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.927687:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef53e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ead7 expref: 62 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.927722:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef545 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ead7 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.927729:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:1.0:1788837752.927732:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837752.927736:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9200, rc 0) 00000100:00100000:1.0:1788837752.928280:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+61:11263:x1875732012771584:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 995us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837752.928289:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 75 00000100:00100000:1.0:1788837752.933613:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837752.933765:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012771968 00000100:00100000:2.0:1788837752.933812:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012771968 00000100:00100000:2.0:1788837752.933935:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:2.0:1788837752.933946:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+61:11263:x1875732012771968:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788837752.934204:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+62:11263:x1875732012771968:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 261us (599us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1788837752.934209:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:3.0:1788837752.936116:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837752.936183:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012772096 00000100:00100000:1.0:1788837752.936264:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012772096 00000100:00100000:1.0:1788837752.936330:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:1.0:1788837752.936341:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1162300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+62:11263:x1875732012772096:12345-192.168.201.3@tcp:103:lfs.0 00010000:00010000:1.0:1788837752.936359:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788837752.936388:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef4d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eabb expref: 62 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.936422:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef530 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ead0 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.936431:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef3d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea75 expref: 60 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837752.936439:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:1.0:1788837752.936458:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837752.936515:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1162300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+59:11263:x1875732012772096:12345-192.168.201.3@tcp:103:lfs.0 Request processed in 176us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837752.936523:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:0.0:1788837752.939734:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837752.939847:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012772224 00000100:00100000:2.0:1788837752.939859:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012772224 00000100:00100000:2.0:1788837752.939917:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 76 00000100:00100000:2.0:1788837752.939927:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+59:11263:x1875732012772224:12345-192.168.201.3@tcp:58:lfs.0 00010000:00010000:2.0:1788837752.940051:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef54c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.940071:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef54c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.940079:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef54c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837752.940343:0:6525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837752.940469:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788837752.941994:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788837752.942105:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+59:11263:x1875732012772224:12345-192.168.201.3@tcp:58:lfs.0 Request processed in 2174us (2377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837752.942116:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 76 00000100:00100000:0.0:1788837752.961828:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837752.961973:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012772352 00000100:00100000:2.0:1788837752.961985:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012772352 00000100:00100000:2.0:1788837752.962050:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 77 00000100:00100000:2.0:1788837752.962061:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+59:11265:x1875732012772352:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837752.962083:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837752.962106:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef553 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eade expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962179:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef55a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962194:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef55a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962304:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef55a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962351:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325a00/0x57f6d4e926aef561 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962360:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325a00/0x57f6d4e926aef561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962366:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325a00/0x57f6d4e926aef561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962522:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aef568 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962533:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aef568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962540:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aef568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837752.962587:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788837752.962592:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788837752.962611:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aef568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962623:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aef568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962631:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef55a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962637:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef55a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962655:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef55a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962661:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837752.962872:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef55a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962883:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef55a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962897:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:2.0:1788837752.962900:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837752.962905:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef55a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962912:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926aef55a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962928:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325a00/0x57f6d4e926aef561 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962935:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325a00/0x57f6d4e926aef561 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962942:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325a00/0x57f6d4e926aef561 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962948:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837752.962951:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325a00/0x57f6d4e926aef561 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962968:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325a00/0x57f6d4e926aef561 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962977:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889ad8ad9000) 00010000:00010000:2.0:1788837752.962980:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837752.962983:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325a00/0x57f6d4e926aef561 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.962989:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325a00/0x57f6d4e926aef561 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.963020:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926aef553 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eade expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.963034:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aef568 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eade expref: 60 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837752.963041:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:2.0:1788837752.963043:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837752.963046:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324400, rc 0) 00000100:00100000:2.0:1788837752.963166:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+60:11265:x1875732012772352:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 1105us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837752.963174:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 77 00000040:00080000:2.0:1788837753.344851:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837753.344861:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837753.344903:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788837753.344910:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788837753.345046:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875732036973440:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788837753.345147:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3748600 going to sleep for 11 seconds 00000100:00100000:2.0:1788837753.351076:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3345880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875732036973440:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788837753.352111:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837753.352151:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012772480 00000100:00100000:2.0:1788837753.352159:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012772480 00000100:00100000:2.0:1788837753.352211:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 78 00000100:00100000:2.0:1788837753.352222:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+60:11276:x1875732012772480:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788837753.352264:0:9317:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788837753.352384:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+60:11276:x1875732012772480:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 163us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837753.352392:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 78 00000001:00080000:3.0:1788837753.358208:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1788837753.358224:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:1.0:1788837753.358354:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef30e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358368:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef30e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358376:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef30e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358382:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837753.358387:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef30e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358395:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef30e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358416:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff889b01a1fa00) 00010000:00010000:1.0:1788837753.358418:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837753.358423:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef30e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358429:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef30e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358448:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef315 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358455:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef315 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358500:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef315 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837753.358504:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788837753.358506:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837753.358511:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef315 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358524:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef315 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358532:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:1.0:1788837753.358535:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837753.358537:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef315 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358542:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef315 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358559:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef354 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358565:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef354 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358570:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef354 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358575:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0030e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837753.358578:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef354 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358595:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef354 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358605:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889ad8ad9000) 00010000:00010000:1.0:1788837753.358606:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837753.358609:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef354 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358614:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef354 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358632:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef45e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358638:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef45e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358643:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef45e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358648:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837753.358650:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef45e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358655:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef45e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358663:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:1.0:1788837753.358665:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837753.358667:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef45e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358684:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef45e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358696:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef481 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358702:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef481 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358707:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef481 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358712:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837753.358715:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef481 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358721:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef481 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358728:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:1.0:1788837753.358730:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837753.358732:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef481 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358737:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926aef481 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358746:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926aef4c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358751:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926aef4c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358763:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926aef4c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358767:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dba00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837753.358796:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926aef4c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358804:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926aef4c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358813:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:1.0:1788837753.358815:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837753.358818:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926aef4c7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.358823:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926aef4c7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837753.365114:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837753.365138:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036973568:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788837753.365213:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837753.365332:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036973568 00000100:00100000:0.0:1788837753.365341:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036973568 00000100:00100000:0.0:1788837753.365410:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788837753.365421:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3651:x1875732036973568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788837753.365449:0:14078:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1788837753.365483:0:14078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f7f77, atime: 0x6a9f7f77, ctime: 0x6a9f7f77, blocks: 0x8 00010000:00010000:0.0:1788837753.365492:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000449c4923/0x57f6d4e926aef56f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.365508:0:14078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=370s v=(0 0) 00010000:00010000:0.0:1788837753.365513:0:14078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00000100:00080000:2.0:1788837753.365521:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788837753.365521:0:14078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000449c4923/0x57f6d4e926aef56f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.365544:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000449c4923/0x57f6d4e926aef56f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.365554:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000449c4923/0x57f6d4e926aef56f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.365563:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000449c4923/0x57f6d4e926aef56f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.365602:0:14078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837753.365623:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837753.365632:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000449c4923/0x57f6d4e926aef56f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.365642:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837753.365647:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000449c4923/0x57f6d4e926aef56f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.365657:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000449c4923/0x57f6d4e926aef56f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.365702:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000449c4923/0x57f6d4e926aef56f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.365710:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000449c4923/0x57f6d4e926aef56f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.365733:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837753.365735:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837753.365737:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837753.365767:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3651:x1875732036973568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 345us (551us total) trans 4294967302 rc 0/0 00000004:00080000:2.0:1788837753.365807:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8899c3344a80/2, rc 0, transno 4294967302 00000100:00100000:0.0:1788837753.365807:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788837753.365817:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036973568:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788837753.366345:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837753.366371:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012772608 00000100:00100000:1.0:1788837753.366376:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012772608 00000100:00100000:1.0:1788837753.366414:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 79 00000100:00100000:1.0:1788837753.366422:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+29:11276:x1875732012772608:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788837753.366476:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef576 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366489:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef576 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366499:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef576 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366586:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef57d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366596:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef57d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366602:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef57d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366636:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef584 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366645:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366651:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837753.366693:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788837753.366710:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837753.366725:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366736:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef576 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366742:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef576 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366747:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef576 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366763:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837753.366767:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef576 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366795:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef576 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366807:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aded2c400) 00010000:00010000:1.0:1788837753.366811:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837753.366815:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef576 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366821:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef576 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366833:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef57d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366839:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef57d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366846:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef57d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366851:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837753.366853:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef57d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366859:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef57d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366877:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff889b01a1f300) 00010000:00010000:1.0:1788837753.366879:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837753.366882:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef57d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366888:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef57d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366901:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366907:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef584 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366913:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef584 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366918:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837753.366921:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef584 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366926:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef584 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366934:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:1.0:1788837753.366935:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837753.366938:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef584 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.366943:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef584 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837753.367017:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+29:11276:x1875732012772608:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 Request processed in 595us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837753.367026:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 79 00000020:00080000:3.0:1788837753.367076:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff889ac4e63240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788837753.367082:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889aded97700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff889ac4e63000 00000020:00080000:3.0:1788837753.367085:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889aded97100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff889afa67d000 00000020:00080000:1.0:1788837753.367222:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788837753.367401:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788837753.372708:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837753.372827:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012772864 00000100:00100000:3.0:1788837753.372840:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012772864 00000100:00100000:3.0:1788837753.372906:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00100000:3.0:1788837753.372916:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+12:11276:x1875732012772864:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837753.372939:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837753.372960:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef58b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eae5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.373065:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef592 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.373080:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef592 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.373091:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef592 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837753.373122:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788837753.373207:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef592 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.373215:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef592 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.373221:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef592 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.373239:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837753.373244:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef592 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.373252:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef592 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.373264:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:3.0:1788837753.373267:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837753.373271:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef592 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.373277:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef592 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.373319:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef58b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eae5 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.373328:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aded2c400) 00010000:00010000:3.0:1788837753.373330:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837753.373339:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef58b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eae5 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.373348:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17c00, rc 0) 00000100:00100000:3.0:1788837753.373409:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+13:11276:x1875732012772864:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 494us (712us total) trans 4294967354 rc 301/301 00000100:00100000:3.0:1788837753.373416:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00100000:3.0:1788837753.378021:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837753.378418:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012772992 00000100:00100000:2.0:1788837753.378434:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012772992 00000100:00100000:2.0:1788837753.378497:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 81 00000100:00100000:2.0:1788837753.378506:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+13:11276:x1875732012772992:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788837753.378545:0:6526:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788837753.378682:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+13:11276:x1875732012772992:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 176us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837753.378691:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 81 00000100:00100000:1.0:1788837753.383156:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837753.383295:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012773248 00000100:00100000:3.0:1788837753.383307:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012773248 00000100:00100000:3.0:1788837753.383373:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 82 00000100:00100000:3.0:1788837753.383383:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+13:11276:x1875732012773248:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837753.383404:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837753.383408:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788837753.383453:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef545 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ead7 expref: 13 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.383472:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:3.0:1788837753.383477:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837753.383491:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef5a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eaec expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837753.384104:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788837753.384268:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef5a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.384283:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.384305:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.384361:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef5a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eaec expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.384378:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef5a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eaec expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.384387:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:3.0:1788837753.384390:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837753.384392:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17c00, rc 0) 00000100:00100000:3.0:1788837753.385269:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+14:11276:x1875732012773248:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 1882us (2119us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788837753.385278:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 82 00000100:00100000:1.0:1788837753.391531:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837753.391621:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012773504 00000100:00100000:2.0:1788837753.391635:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012773504 00000100:00100000:2.0:1788837753.391805:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 83 00000100:00100000:2.0:1788837753.391817:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+14:11276:x1875732012773504:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788837753.391873:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837753.391910:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef5a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eaec expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.391927:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:2.0:1788837753.391937:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837753.391960:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef5b5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.391973:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef5b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.391983:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef5b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392049:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef5bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xdd0e71a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392057:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef5bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdd0e71a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392064:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef5bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdd0e71a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392109:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef5b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392116:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef5b5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392123:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef5b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392129:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837753.392139:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef5b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392148:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef5b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392156:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:2.0:1788837753.392159:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837753.392163:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef5b5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392169:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef5b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392179:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef5bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdd0e71a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392184:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef5bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdd0e71a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392189:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef5bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdd0e71a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392194:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837753.392210:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef5bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdd0e71a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392217:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef5bc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdd0e71a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392224:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xdd0e71a (ffff889afa694500) 00010000:00010000:2.0:1788837753.392226:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837753.392245:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef5bc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xdd0e71a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.392251:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef5bc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xdd0e71a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837753.392342:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+13:11276:x1875732012773504:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 526us (822us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788837753.392350:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 83 00000100:00100000:3.0:1788837753.401112:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837753.401201:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012773632 00000100:00100000:0.0:1788837753.401212:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012773632 00000100:00100000:0.0:1788837753.401280:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 84 00000100:00100000:0.0:1788837753.401291:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+13:11276:x1875732012773632:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837753.401312:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837753.401335:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef5c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eaf3 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.401372:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef5ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.401386:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef5ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.401397:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef5ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.401607:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef5c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eaf3 expref: 15 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.401625:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef5ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eaf3 expref: 14 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.401646:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889aded2cd00) 00010000:00010000:0.0:1788837753.401649:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788837753.401653:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791800, rc 0) 00000100:00100000:0.0:1788837753.401803:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+14:11276:x1875732012773632:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 513us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837753.401810:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 84 00000100:00100000:1.0:1788837753.403921:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837753.403992:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012773888 00000100:00100000:0.0:1788837753.404001:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012773888 00000100:00100000:0.0:1788837753.404063:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 85 00000100:00100000:0.0:1788837753.404072:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+14:11276:x1875732012773888:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837753.404145:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef5d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.404161:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.404172:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837753.404346:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1788837753.404357:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370275580316ns, next at 371275577869ns, rc = 0 00000004:00010000:0.0:1788837753.404406:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ef53560 reply state 0000000003d7f279 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef5d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.404419:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef5d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.404426:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889aded2cd00) 00010000:00010000:0.0:1788837753.404446:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788837753.404450:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837753.404543:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+16:11276:x1875732012773888:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 471us (628us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1788837753.404550:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 85 00000100:00100000:1.0:1788837753.406746:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837753.406887:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012774016 00000100:00100000:3.0:1788837753.406897:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012774016 00000100:00100000:3.0:1788837753.406957:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 86 00000100:00100000:3.0:1788837753.406969:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+16:11276:x1875732012774016:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837753.406994:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837753.407015:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef5d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eafa expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.407070:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef5d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eafa expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.407107:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef5d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eafa expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.407129:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889aded2cd00) 00010000:00010000:3.0:1788837753.407132:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837753.407136:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16a00, rc 0) 00000100:00100000:3.0:1788837753.407196:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+17:11276:x1875732012774016:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 229us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837753.407203:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 86 00000100:00100000:3.0:1788837753.410516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837753.410607:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012774144 00000100:00100000:1.0:1788837753.410618:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012774144 00000100:00100000:1.0:1788837753.410676:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:1.0:1788837753.410684:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875732012774144:12345-192.168.201.3@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788837753.410720:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:1.0:1788837753.410749:0:8439:0:(genops.c:1385:class_connect()) connect: client 3a879e24-3b2f-4404-84c2-9101689d9315, cookie 0x57f6d4e926aef5df 00002000:00100000:1.0:1788837753.410760:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3a879e24-3b2f-4404-84c2-9101689d9315/ffff8899c3568000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788837753.410796:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788837753.410866:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788837753.410891:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8899c356f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837753.410958:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2392:x1875732012774144:12345-192.168.201.3@tcp:8:lhsmtool_posix.0 Request processed in 274us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837753.410966:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:1.0:1788837753.417923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837753.418077:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012774272 00000100:00100000:2.0:1788837753.418088:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012774272 00000100:00100000:2.0:1788837753.418163:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:2.0:1788837753.418175:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:0:x1875732012774272:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788837753.418670:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788837753.424523:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1788837753.424539:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3a879e24-3b2f-4404-84c2-9101689d9315 00000100:00100000:2.0:1788837753.436308:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:0:x1875732012774272:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 18124us (18385us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788837753.436326:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:3.0:1788837753.448470:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837753.448592:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012774528 00000100:00100000:0.0:1788837753.448603:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012774528 00000100:00100000:0.0:1788837753.448668:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:0.0:1788837753.448679:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+17:11276:x1875732012774528:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788837753.448949:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+18:11276:x1875732012774528:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 271us (487us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1788837753.448958:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:3.0:1788837753.457730:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837753.457881:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012774784 00000100:00100000:0.0:1788837753.457892:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012774784 00000100:00100000:0.0:1788837753.457947:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 87 00000100:00100000:0.0:1788837753.457957:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac440b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+18:11276:x1875732012774784:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788837753.458065:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac440b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+18:11276:x1875732012774784:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 110us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837753.458075:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 87 00000100:00100000:3.0:1788837753.461186:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837753.461340:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012774912 00000100:00100000:2.0:1788837753.461351:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012774912 00000100:00100000:2.0:1788837753.461403:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 88 00000100:00100000:2.0:1788837753.461414:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac4409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+18:11276:x1875732012774912:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837753.461447:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837753.461469:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef5e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb01 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.461536:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aef5ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.461552:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aef5ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.461578:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aef5ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837753.461622:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788837753.461641:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aef5ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.461841:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef5e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb01 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.461858:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aef5ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb01 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.461866:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889aded2cd00) 00010000:00010000:2.0:1788837753.461869:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788837753.461872:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324600, rc 0) 00000100:00100000:2.0:1788837753.461924:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac4409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+19:11276:x1875732012774912:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 512us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837753.461931:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 88 00000100:00100000:1.0:1788837753.472143:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837753.472244:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012775040 00000100:00100000:3.0:1788837753.472254:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012775040 00000100:00100000:3.0:1788837753.472317:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:3.0:1788837753.472327:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012775040:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837753.472346:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837753.472369:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef5f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb08 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837753.472397:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7f79, blocks: 0x0 00010000:00010000:3.0:1788837753.472417:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1788837753.472423:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837753.472443:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef5f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb08 expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.472479:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef5f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb08 expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.472493:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16800, rc 0) 00000100:00100000:3.0:1788837753.472549:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:2396:x1875732012775040:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 224us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837753.472556:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:3.0:1788837753.477278:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837753.477326:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012775296 00000100:00100000:3.0:1788837753.477337:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012775296 00000100:00100000:3.0:1788837753.477402:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 89 00000100:00100000:3.0:1788837753.477413:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac4409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+19:11276:x1875732012775296:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788837753.477544:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac4409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+19:11276:x1875732012775296:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 132us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837753.477553:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 89 00000100:00100000:3.0:1788837753.480714:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837753.481392:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012775424 00000100:00100000:2.0:1788837753.481402:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012775424 00000100:00100000:2.0:1788837753.481464:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:2.0:1788837753.481473:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:11276:x1875732012775424:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837753.481491:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837753.481510:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aef5fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb0f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.481558:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef5f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb08 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.481568:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837753.481573:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837753.481578:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aef5fb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb0f expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.481613:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef5f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb08 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.481627:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef5f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb08 expref: 7 pid: 8440 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837753.481641:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875732036973696:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837753.481864:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3748c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837753.489981:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837753.490051:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875732036973696:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788837753.490089:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aef5fb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb0f expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.490112:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1325800, rc 0) 00000100:00100000:1.0:1788837753.490174:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:11276:x1875732012775424:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 8702us (9471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837753.490184:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:0.0:1788837753.490318:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012775552 00000100:00100000:0.0:1788837753.490326:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012775552 00010000:00010000:0.0:1788837753.490360:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef5f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb08 expref: 7 pid: 8440 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837753.490389:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:0.0:1788837753.490412:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012775552:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837753.490427:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837753.490462:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef5f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb08 expref: 7 pid: 8440 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.490476:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef5f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb08 expref: 7 pid: 8440 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.490501:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aef5f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb08 expref: 7 pid: 8440 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.490517:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837753.490522:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837753.490531:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aef5fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb0f expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.490542:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aef5fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb0f expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.490574:0:6511:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aef5fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb0f expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837753.490591:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7f5b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6511:1875732036973824:192.168.201.3@tcp:105: 00000100:00100000:0.0:1788837753.490648:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837753.504138:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837753.504384:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012775680 00000100:00100000:1.0:1788837753.504395:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012775680 00002000:00100000:1.0:1788837753.504507:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8899c3d40a80 x1875732012775680/t0(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:409/0 lens 504/0 e 0 to 0 dl 1788837764 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837753.504519:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c3d40a80 with x1875732012775680 ext(0->8) 00002000:00010000:1.0:1788837753.504524:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8899c3d40a80 00000100:00100000:1.0:1788837753.504558:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:1.0:1788837753.504569:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012775680:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788837753.509483:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7f5b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6511:1875732036973824:192.168.201.3@tcp:105: 00010000:00010000:2.0:1788837753.509513:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837753.509603:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012775552:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 19192us (19629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837753.509614:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:1.0:1788837753.509934:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3a879e24-3b2f-4404-84c2-9101689d9315+8:2395:x1875732012775680:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 Request processed in 5366us (5807us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788837753.509943:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00002000:00100000:1.0:1788837753.509954:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8899c3d40a80 x1875732012775680/t4294967303(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:409/0 lens 504/448 e 0 to 0 dl 1788837764 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837753.509965:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c3d40a80 with x1875732012775680 ext(0->8) 00002000:00010000:1.0:1788837753.509971:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8899c3d40a80 00000100:00100000:3.0:1788837753.515339:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837753.515412:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012775808 00000100:00100000:0.0:1788837753.515421:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012775808 00000100:00100000:0.0:1788837753.515500:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 90 00000100:00100000:0.0:1788837753.515511:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+19:11276:x1875732012775808:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788837753.517059:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:3.0:1788837753.517072:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788837753.517093:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788837753.517115:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788837753.517123:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788837753.517254:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837753.517273:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036973952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788837753.517333:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837753.517396:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036973952 00000100:00100000:2.0:1788837753.517402:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036973952 00000100:00100000:2.0:1788837753.517463:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788837753.517472:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036973952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788837753.517591:0:8544:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788837753.517595:0:8544:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788837753 00002000:00010000:2.0:1788837753.517598:0:8544:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788837753.517600:0:8544:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788837753 -> 1788837753 00002000:00010000:2.0:1788837753.517602:0:8544:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788837753.517645:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036973952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (311us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788837753.517652:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788837753.517675:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788837753.517704:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff889afa5f1c00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788837753.517710:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036973952:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788837753.518220:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef5d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.518243:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef5d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.518251:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef5d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.518258:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837753.518264:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef5d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.518272:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef5d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.518289:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889aded2cd00) 00010000:00010000:0.0:1788837753.518292:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788837753.518297:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef5d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.518302:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef5d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837753.518423:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+14:11276:x1875732012775808:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 Request processed in 2912us (3093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837753.518432:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 90 00000100:00100000:3.0:1788837753.520534:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837753.526606:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012775936 00000100:00100000:0.0:1788837753.526622:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012775936 00010000:00010000:0.0:1788837753.529954:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837753.530199:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:1.0:1788837753.530213:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+8:2393:x1875732012775936:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788837753.531857:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788837753.531870:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1788837753.532088:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2393:x1875732012775936:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 Request processed in 1873us (11557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837753.532099:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:3.0:1788837753.535526:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837753.535631:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012776192 00000100:00100000:0.0:1788837753.535642:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012776192 00000100:00100000:0.0:1788837753.535708:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 91 00000100:00100000:0.0:1788837753.535718:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+14:11276:x1875732012776192:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837753.535924:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837753.535951:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aef5ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb01 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.535968:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889aded2cd00) 00010000:00010000:0.0:1788837753.535973:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837753.536001:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef602 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.536013:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef602 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.536021:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef602 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837753.536138:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002466c51 reply state 0000000095c792cf transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef602 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.536151:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef602 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.536158:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889aded2cd00) 00010000:00010000:0.0:1788837753.536160:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788837753.536163:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837753.536318:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+15:11276:x1875732012776192:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 600us (799us total) trans 4294967358 rc 0/0 00000100:00100000:0.0:1788837753.536337:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 91 00000100:00100000:0.0:1788837753.543759:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837753.545534:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012776320 00000100:00100000:1.0:1788837753.545549:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012776320 00000100:00100000:1.0:1788837753.545880:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:1.0:1788837753.545892:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012776320:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788837753.546042:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788837753.546046:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788837753 -> 1788837752 00002000:00010000:1.0:1788837753.546048:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788837751 00002000:00010000:1.0:1788837753.546050:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788837753 -> 1788837752 00002000:00010000:1.0:1788837753.546052:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788837753.546122:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012776320:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 232us (2373us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788837753.546130:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:3.0:1788837753.548481:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837753.548552:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012776576 00000100:00100000:2.0:1788837753.548564:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012776576 00000100:00100000:2.0:1788837753.548627:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 92 00000100:00100000:2.0:1788837753.548637:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+15:11276:x1875732012776576:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788837753.548711:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.548728:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef5ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eaf3 expref: 15 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.548755:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.548816:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef5ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eaf3 expref: 15 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.548830:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef5ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eaf3 expref: 15 pid: 9317 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837753.548844:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036974080:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837753.548922:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3748600 going to sleep for 11 seconds 00000100:00100000:3.0:1788837753.551266:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036974080:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837753.551293:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837753.552519:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837753.552595:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012776704 00000100:00100000:1.0:1788837753.552604:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012776704 00010000:00010000:1.0:1788837753.552644:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef5ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eaf3 expref: 16 pid: 9317 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837753.552701:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:1.0:1788837753.552711:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+16:2395:x1875732012776704:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837753.552726:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837753.552733:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef5ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eaf3 expref: 16 pid: 9317 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.552764:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef5ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eaf3 expref: 16 pid: 9317 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.552815:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef5ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eaf3 expref: 16 pid: 9317 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.552831:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889aded2cd00) 00010000:00010000:1.0:1788837753.552836:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.552845:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.552853:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.552879:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837753.552928:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+15:2395:x1875732012776704:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 217us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837753.552934:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 60 00010000:00010000:0.0:1788837753.553006:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.553015:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.553058:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.553066:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.553074:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.553080:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837753.553084:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.553092:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.553101:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889aded2cd00) 00010000:00010000:0.0:1788837753.553104:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788837753.553107:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.553112:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef609 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837753.553163:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+14:11276:x1875732012776576:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 Request processed in 4528us (4692us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788837753.553172:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 92 00000100:00100000:0.0:1788837753.558212:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837753.558294:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012776832 00000100:00100000:2.0:1788837753.558304:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012776832 00000100:00100000:2.0:1788837753.558359:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:2.0:1788837753.558370:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+7:2394:x1875732012776832:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788837753.558411:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000adf039f9/0x57f6d4e926aef610 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.558430:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aef5fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb0f expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.558448:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837753.558452:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837753.558456:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf039f9/0x57f6d4e926aef610 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.558502:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aef5fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb0f expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.558516:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aef5fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb0f expref: 7 pid: 8441 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837753.558531:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875732036974208:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837753.558610:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3748d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837753.561703:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875732036974208:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837753.561733:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000adf039f9/0x57f6d4e926aef610 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837753.562918:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837753.563010:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012776960 00000100:00100000:1.0:1788837753.563018:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012776960 00010000:00010000:1.0:1788837753.563056:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aef5fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb0f expref: 8 pid: 8441 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837753.563093:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:1.0:1788837753.563102:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+8:2396:x1875732012776960:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837753.563135:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837753.563158:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aef5fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb0f expref: 8 pid: 8441 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.563171:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aef5fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb0f expref: 8 pid: 8441 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.563210:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aef5fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb0f expref: 8 pid: 8441 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.563238:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837753.563243:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837753.563250:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000adf039f9/0x57f6d4e926aef610 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.563264:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf039f9/0x57f6d4e926aef610 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.563287:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837753.563349:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:2396:x1875732012776960:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 246us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837753.563357:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 61 00010000:00010000:3.0:1788837753.563605:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000adf039f9/0x57f6d4e926aef610 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.563615:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf039f9/0x57f6d4e926aef610 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.563635:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000adf039f9/0x57f6d4e926aef610 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.563643:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adf039f9/0x57f6d4e926aef610 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.563651:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adf039f9/0x57f6d4e926aef610 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.563658:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325e00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837753.563674:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf039f9/0x57f6d4e926aef610 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.563683:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf039f9/0x57f6d4e926aef610 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.563742:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adf039f9/0x57f6d4e926aef610 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.563751:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf039f9/0x57f6d4e926aef610 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837753.563847:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:2394:x1875732012776832:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 Request processed in 5479us (5646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837753.563856:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:2.0:1788837753.574137:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837753.576169:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012777216 00000100:00100000:3.0:1788837753.576183:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012777216 00000100:00100000:3.0:1788837753.576263:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 93 00000100:00100000:3.0:1788837753.576274:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+14:11276:x1875732012777216:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788837753.576356:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.576374:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef457 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea98 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.576385:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.576424:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef457 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea98 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.576439:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef457 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea98 expref: 14 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837753.576464:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d43b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036974336:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788837753.576563:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4e63240 going to sleep for 11 seconds 00000100:00100000:3.0:1788837753.583054:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d43b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036974336:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837753.583089:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837753.585651:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837753.585907:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012777344 00000100:00100000:1.0:1788837753.585918:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012777344 00010000:00010000:1.0:1788837753.585959:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef457 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea98 expref: 15 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837753.586022:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:1.0:1788837753.586033:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+15:2396:x1875732012777344:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837753.586049:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837753.586056:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef457 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea98 expref: 15 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.586080:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef457 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea98 expref: 15 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.586102:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef457 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ea98 expref: 15 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.586117:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:1.0:1788837753.586123:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.586133:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.586141:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.586177:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837753.586254:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+14:2396:x1875732012777344:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 194us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837753.586263:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 62 00010000:00010000:0.0:1788837753.586615:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.586624:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.586824:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.586836:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef5d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eafa expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.586843:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.586872:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef5d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eafa expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837753.586885:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef5d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eafa expref: 14 pid: 6525 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837753.586897:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036974464:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837753.586960:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac52303c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837753.591495:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837753.591660:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036974464:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837753.591687:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837753.591802:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012777472 00000100:00100000:2.0:1788837753.591810:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012777472 00010000:00010000:2.0:1788837753.591847:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef5d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eafa expref: 15 pid: 6525 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837753.591883:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:2.0:1788837753.591892:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+15:2395:x1875732012777472:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837753.591905:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837753.591911:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef5d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eafa expref: 15 pid: 6525 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.591935:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef5d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eafa expref: 15 pid: 6525 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.591958:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef5d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eafa expref: 15 pid: 6525 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.591973:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889aded2cd00) 00010000:00010000:2.0:1788837753.591978:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.591987:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.591995:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.592017:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837753.592068:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+14:2395:x1875732012777472:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 176us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837753.592076:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 63 00010000:00010000:2.0:1788837753.592163:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.592170:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837753.592278:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1788837753.592391:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:2.0:1788837753.592426:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788837753.592529:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6524:1875732036974592:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788837753.592573:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837753.592599:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837753.592616:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036974592 00000100:00100000:2.0:1788837753.592620:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036974592 00000100:00100000:2.0:1788837753.592650:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788837753.592657:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1875732036974592:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788837753.592729:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1875732036974592:12345-0@lo:1000:mdt00_000.0 Request processed in 71us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837753.592736:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788837753.592769:0:6524:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788837753.592794:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff889afa5f1c00, transno 4294967304 00000100:00100000:2.0:1788837753.592805:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6524:1875732036974592:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788837753.592904:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:2.0:1788837753.592938:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6524:1875732036974720:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788837753.592965:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837753.592979:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837753.593044:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036974720 00000100:00100000:2.0:1788837753.593048:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036974720 00000100:00100000:2.0:1788837753.593070:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788837753.593075:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1875732036974720:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788837753.593160:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6524:x1875732036974720:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (194us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788837753.593167:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788837753.593195:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6524:1875732036974720:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788837753.593223:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593253:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593260:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593266:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837753.593271:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593280:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593291:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889aded2cd00) 00010000:00010000:2.0:1788837753.593294:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837753.593298:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593304:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef61e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593331:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef54c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593337:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef54c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593342:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef54c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593347:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dae00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837753.593355:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef54c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593362:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef54c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593370:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:2.0:1788837753.593372:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837753.593375:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef54c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593381:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926aef54c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593400:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593413:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aef568 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eade expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593421:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593442:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aef568 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eade expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.593456:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aef568 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eade expref: 17 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837753.593466:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036974848:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837753.593517:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837753.596906:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036974848:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837753.596938:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837753.599590:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837753.600534:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012777600 00000100:00100000:1.0:1788837753.600557:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012777600 00010000:00010000:1.0:1788837753.600598:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aef568 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eade expref: 18 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837753.600683:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:1.0:1788837753.600693:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+18:2394:x1875732012777600:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837753.600708:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837753.600715:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aef568 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eade expref: 18 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.600730:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aef568 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eade expref: 18 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.600754:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aef568 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eade expref: 18 pid: 6526 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.600767:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:1.0:1788837753.600772:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.600879:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.600888:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.600924:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837753.601030:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+17:2394:x1875732012777600:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 337us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837753.601048:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 64 00010000:00010000:2.0:1788837753.601097:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601105:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601117:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601123:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601130:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601135:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837753.601140:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601147:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601156:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:2.0:1788837753.601159:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837753.601162:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601178:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef625 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601188:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601193:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601212:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601218:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837753.601220:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601235:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601244:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889afa694200) 00010000:00010000:2.0:1788837753.601246:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788837753.601249:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837753.601255:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef617 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837753.601398:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+16:11276:x1875732012777216:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 25126us (27273us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788837753.601406:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 93 00000020:00080000:2.0:1788837753.601415:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788837753.601520:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837753.601525:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837753.601540:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788837753.601547:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788837753.604653:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837753.604998:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012777856 00000100:00100000:3.0:1788837753.605008:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012777856 00000100:00100000:3.0:1788837753.605067:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:3.0:1788837753.605076:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+16:11276:x1875732012777856:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788837753.605360:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788837753.605394:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00010000:00010000:3.0:1788837753.605440:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef62c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.605464:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.605476:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef62c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.605485:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef62c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.605508:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef62c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.605514:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef62c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837753.605535:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788837753.605628:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+18:11276:x1875732012777856:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 552us (984us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788837753.605636:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000020:00080000:3.0:1788837753.605641:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788837753.605821:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837753.605829:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef62c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.605837:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837753.605841:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef62c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.605850:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef62c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.605866:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889aded2cd00) 00010000:00010000:1.0:1788837753.605869:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788837753.605875:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef62c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.605881:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef62c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837753.605896:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837753.605898:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837753.605899:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837753.785322:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036974976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837753.785410:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837753.785624:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036974976 00000100:00100000:0.0:1788837753.785765:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036974976 00000100:00100000:0.0:1788837753.785850:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788837753.785861:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036974976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837753.785894:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788837753.785945:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036974976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837753.785952:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788837753.786831:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036974976:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788837753.807277:0:14215:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837753.807287:0:14215:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837753.807314:0:14215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788837753.807320:0:14215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837753.843797:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837753.843833:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837753.843863:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837753.843882:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837753.843904:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837753.843932:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012777984 00000100:00100000:3.0:1788837753.843942:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012777984 00000100:00100000:3.0:1788837753.843993:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 377 00000100:00100000:3.0:1788837753.844003:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012777984:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837753.844025:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012778112 00000100:00100000:1.0:1788837753.844030:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012778112 00000100:00100000:1.0:1788837753.844066:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012778368 00000100:00100000:1.0:1788837753.844069:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012778368 00000100:00100000:3.0:1788837753.844083:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8f66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012777984:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837753.844091:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 377 00000100:00100000:1.0:1788837753.844096:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012778496 00000100:00100000:1.0:1788837753.844098:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012778496 00000100:00100000:3.0:1788837753.844123:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012778240 00000100:00100000:1.0:1788837753.844124:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 269 00000100:00100000:3.0:1788837753.844126:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012778240 00000100:00100000:1.0:1788837753.844130:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012778112:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837753.844152:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 115 00000100:00100000:3.0:1788837753.844158:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:2393:x1875732012778240:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837753.844167:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012778112:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 38us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837753.844174:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 269 00000100:00100000:3.0:1788837753.844178:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:2393:x1875732012778240:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 21us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837753.844184:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 115 00000100:00100000:1.0:1788837753.844187:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 270 00000100:00100000:1.0:1788837753.844193:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012778368:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837753.844200:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 271 00000100:00100000:3.0:1788837753.844206:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012778496:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837753.844215:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012778368:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837753.844233:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 270 00000100:00100000:3.0:1788837753.844239:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012778496:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 34us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837753.844246:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 271 00000100:00080000:1.0:1788837753.844249:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837753.844253:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837753.844255:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788837753.999751:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.004553:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012778752 00000100:00100000:1.0:1788837754.004576:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012778752 00000100:00100000:1.0:1788837754.004687:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 94 00000100:00100000:1.0:1788837754.004699:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+18:11286:x1875732012778752:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788837754.004726:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837754.004749:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef633 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb16 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788837754.004818:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788837754.004885:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef63a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.004913:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef63a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.004926:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef63a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837754.004951:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788837754.005080:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef633 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb16 expref: 21 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.005097:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef63a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb16 expref: 20 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.005106:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:1.0:1788837754.005109:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788837754.005112:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9600, rc 0) 00000100:00100000:1.0:1788837754.005191:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+20:11286:x1875732012778752:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 493us (5449us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788837754.005199:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 94 00000100:00100000:0.0:1788837754.013248:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.016977:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012778880 00000100:00100000:1.0:1788837754.017010:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012778880 00000100:00100000:1.0:1788837754.017078:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 95 00000100:00100000:1.0:1788837754.017089:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+20:11286:x1875732012778880:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:1.0:1788837754.017173:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef648 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.017195:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef648 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.017207:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef648 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.017235:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef64f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.017256:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef64f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.017263:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef64f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.017365:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef656 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.017374:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef656 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.017381:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef656 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837754.018580:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef656 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018600:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef648 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018608:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef648 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018615:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef648 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018621:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837754.018626:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef648 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018633:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef648 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018728:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:1.0:1788837754.018732:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837754.018737:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef648 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018744:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef648 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018756:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef64f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018762:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef64f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018767:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef64f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018773:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837754.018789:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef64f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018795:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef64f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018804:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889b01a1f600) 00010000:00010000:1.0:1788837754.018806:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837754.018809:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef64f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018815:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef64f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018842:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef656 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018848:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef656 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018854:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef656 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018859:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837754.018862:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef656 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018869:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef656 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018876:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889b01a1f000) 00010000:00010000:1.0:1788837754.018879:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837754.018881:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef656 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.018887:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef656 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837754.019148:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+20:11286:x1875732012778880:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 2055us (5905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837754.019158:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 95 00000100:00100000:2.0:1788837754.094904:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.095046:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012779136 00000100:00100000:0.0:1788837754.095058:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012779136 00000100:00100000:0.0:1788837754.095135:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 96 00000100:00100000:0.0:1788837754.095144:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+20:11289:x1875732012779136:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837754.095165:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837754.095184:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef65d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb1d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095273:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef664 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095291:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef664 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095300:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef664 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095311:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef66b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095323:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef66b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095327:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef66b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095599:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef672 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095606:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef672 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095611:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef672 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837754.095617:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788837754.095688:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef664 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095696:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef664 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095703:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef664 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095709:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837754.095712:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef664 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095718:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef664 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095736:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:0.0:1788837754.095738:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837754.095741:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef664 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095745:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef664 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095754:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef66b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095758:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef66b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095761:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef66b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095764:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837754.095766:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef66b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095769:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef66b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095772:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889aded2ce00) 00010000:00010000:0.0:1788837754.095774:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837754.095819:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef66b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095823:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef66b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095864:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef65d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb1d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095874:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef672 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb1d expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.095878:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:0.0:1788837754.095880:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837754.095881:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791800, rc 0) 00000100:00100000:0.0:1788837754.095951:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+22:11289:x1875732012779136:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 807us (1061us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788837754.095957:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 96 00000100:00100000:0.0:1788837754.101546:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.101672:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012779264 00000100:00100000:1.0:1788837754.101683:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012779264 00000100:00100000:1.0:1788837754.101746:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 97 00000100:00100000:1.0:1788837754.101770:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+22:11289:x1875732012779264:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:1.0:1788837754.101852:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef680 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.101866:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.101874:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.101908:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef680 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.101915:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef680 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.101922:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef680 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.101929:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837754.101934:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef680 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.101942:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef680 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.101954:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:1.0:1788837754.101957:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837754.101960:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef680 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.101965:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef680 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837754.102045:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+22:11289:x1875732012779264:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 272us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837754.102051:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 97 00000100:00100000:3.0:1788837754.104293:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.104900:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012779520 00000100:00100000:0.0:1788837754.104911:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012779520 00000100:00100000:0.0:1788837754.104961:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:0.0:1788837754.104969:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8e7b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+22:11289:x1875732012779520:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:0.0:1788837754.105183:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8e7b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+23:11289:x1875732012779520:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 213us (899us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1788837754.105191:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:2.0:1788837754.148349:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.148465:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012779776 00000100:00100000:0.0:1788837754.148476:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012779776 00000100:00100000:0.0:1788837754.148548:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 98 00000100:00100000:0.0:1788837754.148559:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+23:10816:x1875732012779776:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:0.0:1788837754.148587:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837754.148626:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef687 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb24 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.148747:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.148763:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef672 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb1d expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.148772:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.148841:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef672 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb1d expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.148856:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef672 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb1d expref: 24 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837754.148870:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875732036975104:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837754.148972:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230240 going to sleep for 11 seconds 00000100:00100000:0.0:1788837754.153278:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875732036975104:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837754.153311:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837754.154568:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.154711:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012779904 00000100:00100000:0.0:1788837754.154719:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012779904 00010000:00010000:0.0:1788837754.154760:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef672 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb1d expref: 25 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837754.154849:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:0.0:1788837754.154858:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+25:2395:x1875732012779904:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837754.154874:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837754.154882:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef672 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb1d expref: 25 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.154894:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef672 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb1d expref: 25 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.154918:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef672 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb1d expref: 25 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.154934:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:0.0:1788837754.154939:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.154948:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.154955:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.154991:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837754.155055:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+24:2395:x1875732012779904:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 197us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837754.155062:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 65 00010000:00010000:3.0:1788837754.155139:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.155149:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837754.155175:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788837754.155345:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef687 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb24 expref: 25 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.155385:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb24 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.155393:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:3.0:1788837754.155396:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788837754.155398:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791200, rc 0) 00000100:00100000:3.0:1788837754.155442:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+24:10816:x1875732012779776:12345-192.168.201.3@tcp:101:bash.0 Request processed in 6885us (7106us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788837754.155449:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 98 00000100:00100000:2.0:1788837754.159885:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.162367:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012780032 00000100:00100000:1.0:1788837754.162383:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012780032 00000100:00100000:1.0:1788837754.162506:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 99 00000100:00100000:1.0:1788837754.162518:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+24:10816:x1875732012780032:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788837754.162545:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837754.162568:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef69c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb2b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.162606:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef6a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.162622:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.162634:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.162768:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef69c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb2b expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.162814:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb2b expref: 25 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.162823:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:1.0:1788837754.162834:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788837754.162838:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8000, rc 0) 00000100:00100000:1.0:1788837754.162919:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+25:10816:x1875732012780032:12345-192.168.201.3@tcp:101:bash.0 Request processed in 403us (3044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837754.162927:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 99 00000100:00100000:0.0:1788837754.165623:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.165769:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012780288 00000100:00100000:1.0:1788837754.165911:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012780288 00000100:00100000:1.0:1788837754.166021:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 100 00000100:00100000:1.0:1788837754.166033:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+25:10816:x1875732012780288:12345-192.168.201.3@tcp:36:bash.0 00010000:00010000:1.0:1788837754.166293:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef6aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.166311:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef6aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.166322:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef6aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788837754.166377:0:9317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000004:00010000:1.0:1788837754.166400:0:9317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000092e3a0f reply state 000000000680410b transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef6aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.166412:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef6aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.166419:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:1.0:1788837754.166422:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788837754.166426:0:9317:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788837754.166465:0:9317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:1.0:1788837754.166585:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+29:10816:x1875732012780288:12345-192.168.201.3@tcp:36:bash.0 Request processed in 553us (972us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788837754.166605:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 100 00000020:00080000:1.0:1788837754.166610:0:9317:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788837754.169042:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.169154:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012780416 00000100:00100000:1.0:1788837754.169164:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012780416 00000100:00100000:1.0:1788837754.169491:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 101 00000100:00100000:1.0:1788837754.169502:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+29:10816:x1875732012780416:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788837754.169526:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837754.169547:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef6b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb32 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.169612:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef6b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb32 expref: 30 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.169627:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef6b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb32 expref: 30 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.169657:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:1.0:1788837754.169662:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788837754.169665:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8800, rc 0) 00000100:00100000:1.0:1788837754.169799:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+30:10816:x1875732012780416:12345-192.168.201.3@tcp:101:bash.0 Request processed in 299us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837754.169806:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 101 00000100:00100000:3.0:1788837754.173863:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.173953:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012780544 00000100:00100000:1.0:1788837754.173963:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012780544 00000100:00100000:1.0:1788837754.174016:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:1.0:1788837754.174026:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:10816:x1875732012780544:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788837754.174062:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837754.174083:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926aef6b8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb39 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837754.174111:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f7f78, atime: 0x6a9f7f77, ctime: 0x6a9f7f78, blocks: 0x8 00010000:00010000:1.0:1788837754.174131:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1788837754.174136:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837754.174144:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926aef6b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb39 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.174162:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926aef6b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb39 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.174173:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9a00, rc 0) 00000100:00100000:1.0:1788837754.174408:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:10816:x1875732012780544:12345-192.168.201.3@tcp:101:bash.0 Request processed in 382us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837754.174416:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:3.0:1788837754.176849:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.177036:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012780672 00000100:00100000:0.0:1788837754.177048:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012780672 00002000:00010000:0.0:1788837754.177092:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1788837754.177098:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c3d42300 with x1875732012780672 ext(0->18446744073709551615) 00002000:00010000:0.0:1788837754.177111:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8899c3d42300. 00000100:00100000:0.0:1788837754.177144:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:0.0:1788837754.177156:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:2396:x1875732012780672:12345-192.168.201.3@tcp:10:bash.0 00002000:00010000:0.0:1788837754.177473:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788837754.177477:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788837752 -> 1788837754 00002000:00010000:0.0:1788837754.177480:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788837751 -> 1788837751 00002000:00010000:0.0:1788837754.177483:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788837752 -> 1788837754 00002000:00010000:0.0:1788837754.177485:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788837754.177559:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3a879e24-3b2f-4404-84c2-9101689d9315+8:2396:x1875732012780672:12345-192.168.201.3@tcp:10:bash.0 Request processed in 405us (720us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788837754.177566:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00002000:00010000:0.0:1788837754.177570:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1788837754.177573:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c3d42300 with x1875732012780672 ext(0->18446744073709551615) 00002000:00010000:0.0:1788837754.177577:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8899c3d42300. 00000100:00100000:3.0:1788837754.266709:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.266872:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012780800 00000100:00100000:0.0:1788837754.266886:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012780800 00000100:00100000:0.0:1788837754.266959:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 102 00000100:00100000:0.0:1788837754.266971:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+30:11303:x1875732012780800:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:0.0:1788837754.267074:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267093:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267117:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267133:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267140:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267144:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267229:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267239:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267245:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837754.267290:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267302:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267308:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267315:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267332:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837754.267336:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267344:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267369:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:0.0:1788837754.267372:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837754.267377:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267384:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267397:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267403:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267408:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267413:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837754.267426:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267433:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267451:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889aded2ce00) 00010000:00010000:0.0:1788837754.267453:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837754.267456:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267462:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267478:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267485:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267490:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267495:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837754.267498:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267504:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267511:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:0.0:1788837754.267513:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837754.267516:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.267521:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837754.267628:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+30:11303:x1875732012780800:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 658us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837754.267637:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 102 00000100:00100000:2.0:1788837754.321724:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.321902:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012781056 00000100:00100000:1.0:1788837754.321915:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012781056 00000100:00100000:0.0:1788837754.322116:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 103 00000100:00100000:0.0:1788837754.322129:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+30:11306:x1875732012781056:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837754.322151:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837754.322176:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb40 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322288:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6db lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322302:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322313:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322326:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322333:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322338:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322458:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef6e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322486:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322492:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837754.322502:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788837754.322582:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322589:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6db lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322595:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322601:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837754.322605:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322612:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6db lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322623:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:0.0:1788837754.322626:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837754.322630:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322635:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef6db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322660:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322673:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322679:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322684:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837754.322687:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322693:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322702:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889aded2ce00) 00010000:00010000:0.0:1788837754.322704:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837754.322707:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322713:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef6e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322753:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb40 expref: 33 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322766:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb40 expref: 32 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.322773:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:0.0:1788837754.322828:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788837754.322836:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791400, rc 0) 00000100:00100000:0.0:1788837754.322907:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+32:11306:x1875732012781056:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 781us (1193us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788837754.322915:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 103 00000100:00100000:2.0:1788837754.328707:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.328826:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012781184 00000100:00100000:0.0:1788837754.328838:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012781184 00000100:00100000:0.0:1788837754.328916:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 104 00000100:00100000:0.0:1788837754.328927:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+32:11306:x1875732012781184:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:0.0:1788837754.329009:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.329027:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb24 expref: 32 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.329036:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.329077:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb24 expref: 32 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.329091:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb24 expref: 32 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837754.329105:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36df800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875732036975232:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837754.329225:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230540 going to sleep for 11 seconds 00000100:00100000:3.0:1788837754.333917:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.334181:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012781440 00000100:00100000:1.0:1788837754.334191:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012781440 00000100:00100000:1.0:1788837754.334271:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:1.0:1788837754.334283:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+33:6164:x1875732012781440:12345-192.168.201.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788837754.334652:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+34:6164:x1875732012781440:12345-192.168.201.3@tcp:35:ldlm_bl.0 Request processed in 369us (744us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788837754.334660:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:0.0:1788837754.335839:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36df800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875732036975232:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837754.335867:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837754.338872:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837754.338966:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012781568 00000100:00100000:3.0:1788837754.338985:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012781568 00010000:00010000:3.0:1788837754.339027:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb24 expref: 34 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837754.339067:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:3.0:1788837754.339075:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+34:2395:x1875732012781568:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837754.339090:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837754.339096:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb24 expref: 34 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.339107:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb24 expref: 34 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.339142:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef68e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb24 expref: 34 pid: 6526 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.339156:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:3.0:1788837754.339161:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.339169:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.339175:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.339204:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837754.339272:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+33:2395:x1875732012781568:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 196us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837754.339280:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 66 00010000:00010000:0.0:1788837754.339528:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.339537:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.339574:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.339581:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.339588:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.339594:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837754.339598:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.339604:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.339613:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:0.0:1788837754.339616:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837754.339619:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.339625:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837754.339667:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+32:11306:x1875732012781184:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 10742us (10971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837754.339681:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 104 00000100:00100000:3.0:1788837754.343739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.343902:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012781824 00000100:00100000:1.0:1788837754.343912:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012781824 00000100:00100000:1.0:1788837754.343963:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:1.0:1788837754.343972:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+32:11306:x1875732012781824:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:1.0:1788837754.344223:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+33:11306:x1875732012781824:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 242us (483us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788837754.344231:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:2.0:1788837754.458850:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.458904:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012782080 00000100:00100000:0.0:1788837754.458914:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012782080 00000100:00100000:0.0:1788837754.459025:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 105 00000100:00100000:0.0:1788837754.459036:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+33:11317:x1875732012782080:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:0.0:1788837754.459062:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837754.459084:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb47 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459162:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef705 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459176:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef705 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459186:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef705 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459201:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef70c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459240:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef70c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459249:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef70c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459373:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef713 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459401:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459406:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837754.459423:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788837754.459500:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef705 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459506:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef705 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459510:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef705 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459514:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837754.459517:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef705 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459523:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef705 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459532:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:0.0:1788837754.459533:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837754.459537:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef705 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459541:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef705 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459550:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef70c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459558:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef70c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459562:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef70c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459565:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837754.459566:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef70c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459570:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef70c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459574:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889aded2ce00) 00010000:00010000:0.0:1788837754.459575:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837754.459577:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef70c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459580:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef70c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459610:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef6fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb47 expref: 36 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459619:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef713 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb47 expref: 35 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.459624:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:0.0:1788837754.459625:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837754.459631:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791200, rc 0) 00000100:00100000:0.0:1788837754.459697:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+35:11317:x1875732012782080:12345-192.168.201.3@tcp:101:cat.0 Request processed in 664us (858us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788837754.459702:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 105 00000100:00100000:3.0:1788837754.463798:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.463885:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012782336 00000100:00100000:1.0:1788837754.463896:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012782336 00000100:00100000:1.0:1788837754.463991:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:1.0:1788837754.464002:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+35:11317:x1875732012782336:12345-192.168.201.3@tcp:35:cat.0 00000100:00100000:1.0:1788837754.464266:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+36:11317:x1875732012782336:12345-192.168.201.3@tcp:35:cat.0 Request processed in 264us (506us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788837754.464272:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:3.0:1788837754.478271:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.478700:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012782592 00000100:00100000:1.0:1788837754.478710:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012782592 00000100:00100000:1.0:1788837754.478757:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 106 00000100:00100000:1.0:1788837754.478764:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+36:11318:x1875732012782592:12345-192.168.201.3@tcp:36:rm.0 00010000:00010000:1.0:1788837754.478847:0:9317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788837754.478874:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef6b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb32 expref: 36 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.478894:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef713 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb47 expref: 35 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.478906:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef6e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb40 expref: 34 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.478934:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef6a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb2b expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.478945:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:1.0:1788837754.478951:0:9317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837754.478971:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef721 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.478986:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef721 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.478996:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef721 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479010:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef728 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479017:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef728 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479024:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef728 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479092:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef72f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479098:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef72f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479102:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef72f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788837754.479299:0:9317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788837754.479307:0:9317:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371350529843ns, next at 372350527671ns, rc = 0 00010000:00010000:1.0:1788837754.479355:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef736 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479362:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479367:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479371:0:9317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef736 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479375:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef736 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479379:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef736 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479388:0:9317:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837754.479400:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef72f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479403:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef72f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479407:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef72f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479411:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837754.479502:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837754.479508:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef736 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.479512:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837754.479515:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef736 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.479520:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef736 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.479527:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:2.0:1788837754.479529:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788837754.479532:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef736 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.479535:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef736 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.479548:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837754.479550:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837754.479551:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837754.479621:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef72f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479626:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef72f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479632:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:1.0:1788837754.479634:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788837754.479635:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef72f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479639:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef72f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479649:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef721 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479652:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef721 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479656:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef721 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479659:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837754.479661:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef721 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479664:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef721 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479667:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:1.0:1788837754.479668:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837754.479673:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef721 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479677:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef721 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837754.479683:0:9317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019cd9634 reply state 0000000024a20d53 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef728 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479690:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef728 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.479694:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889b01a1f100) 00010000:00010000:1.0:1788837754.479695:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788837754.479697:0:9317:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788837754.479762:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+34:11318:x1875732012782592:12345-192.168.201.3@tcp:36:rm.0 Request processed in 997us (1507us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788837754.479767:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 106 00000100:00100000:3.0:1788837754.507099:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.507226:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012782848 00000100:00100000:1.0:1788837754.507236:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012782848 00000100:00100000:1.0:1788837754.507300:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 107 00000100:00100000:1.0:1788837754.507312:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+34:11324:x1875732012782848:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788837754.507338:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837754.507369:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef73d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb4e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.507470:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef744 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.507485:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef744 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.507506:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef744 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.507517:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef74b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.507523:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef74b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.507529:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef74b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788837754.507888:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788837754.508025:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef752 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.508035:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.508042:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.508075:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef744 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.508082:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef744 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.508089:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef744 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.508095:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837754.508107:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef744 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.508116:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef744 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.508128:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:1.0:1788837754.508132:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837754.508137:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef744 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.508143:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef744 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837754.508157:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000031908d4 reply state 0000000067efc958 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef74b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.508167:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef74b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.508173:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889b01a1f100) 00010000:00010000:1.0:1788837754.508175:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788837754.508177:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788837754.508205:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef73d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb4e expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.508231:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef752 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb4e expref: 36 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.508238:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889b01a1f900) 00010000:00010000:1.0:1788837754.508241:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837754.508250:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8800, rc 0) 00000100:00100000:1.0:1788837754.508545:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+37:11324:x1875732012782848:12345-192.168.201.3@tcp:101:bash.0 Request processed in 1234us (1453us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788837754.508553:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 107 00000100:00100000:3.0:1788837754.511818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.511902:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012782976 00000100:00100000:1.0:1788837754.511913:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012782976 00000100:00100000:1.0:1788837754.511974:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:1.0:1788837754.511985:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012782976:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788837754.512004:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837754.512026:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aef760 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb55 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837754.512056:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837754.512078:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1788837754.512084:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837754.512094:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aef760 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb55 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.512115:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aef760 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb55 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.512129:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9000, rc 0) 00000100:00100000:1.0:1788837754.512556:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+8:2395:x1875732012782976:12345-192.168.201.3@tcp:101:bash.0 Request processed in 570us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837754.512564:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:3.0:1788837754.517846:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.518221:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012783104 00000100:00100000:0.0:1788837754.518233:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012783104 00000100:00100000:0.0:1788837754.518295:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:0.0:1788837754.518304:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+8:11324:x1875732012783104:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:0.0:1788837754.518324:0:8544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837754.518352:0:8544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb5c expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.518388:0:8544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aef760 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb55 expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.518399:0:8544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837754.518403:0:8544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837754.518408:0:8544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 9 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.518455:0:8544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aef760 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb55 expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.518470:0:8544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aef760 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb55 expref: 9 pid: 8440 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837754.518486:0:8544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8544:1875732036975360:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837754.518841:0:8544:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837754.521667:0:8544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8544:1875732036975360:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837754.521704:0:8544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 9 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.521725:0:8544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa790200, rc 0) 00000100:00100000:0.0:1788837754.521819:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+9:11324:x1875732012783104:12345-192.168.201.3@tcp:101:bash.0 Request processed in 3515us (3984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837754.521828:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:3.0:1788837754.522079:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.522452:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012783232 00000100:00100000:0.0:1788837754.522460:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012783232 00010000:00010000:0.0:1788837754.522492:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aef760 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb55 expref: 9 pid: 8440 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837754.522532:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:0.0:1788837754.522542:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+9:2395:x1875732012783232:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837754.522556:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837754.522578:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aef760 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb55 expref: 9 pid: 8440 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.522591:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aef760 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb55 expref: 9 pid: 8440 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.522613:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aef760 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb55 expref: 9 pid: 8440 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.522646:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837754.522650:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837754.522669:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 8 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.522680:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 8 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.522714:0:6511:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 8 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837754.522728:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6511:1875732036975488:192.168.201.3@tcp:105: 00000100:00100000:0.0:1788837754.522879:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837754.525872:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6511:1875732036975488:192.168.201.3@tcp:105: 00010000:00010000:0.0:1788837754.525903:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837754.525954:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+8:2395:x1875732012783232:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 3412us (3874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837754.525965:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:2.0:1788837754.527192:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.527440:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012783488 00000100:00100000:0.0:1788837754.527449:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012783488 00000100:00100000:0.0:1788837754.527504:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:0.0:1788837754.527514:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+37:11324:x1875732012783488:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:0.0:1788837754.527850:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+38:11324:x1875732012783488:12345-192.168.201.3@tcp:35:bash.0 Request processed in 335us (662us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788837754.527875:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00010000:00010000:0.0:1788837754.553018:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837754.694239:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837754.694380:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012783616 00000100:00100000:3.0:1788837754.694391:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012783616 00000100:00100000:3.0:1788837754.694465:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 108 00000100:00100000:3.0:1788837754.694476:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+38:11340:x1875732012783616:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788837754.694518:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837754.694542:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef76e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb63 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.694617:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef775 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.694632:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.694654:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837754.694704:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788837754.694708:0:9317:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837754.694729:0:9317:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.694752:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef76e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb63 expref: 40 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.694770:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb63 expref: 39 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.694828:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:3.0:1788837754.694831:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837754.694835:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17c00, rc 0) 00000100:00100000:3.0:1788837754.694903:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+39:11340:x1875732012783616:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 428us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837754.694911:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 108 00000100:00100000:3.0:1788837754.699145:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.699364:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012783872 00000100:00100000:0.0:1788837754.699376:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012783872 00000100:00100000:0.0:1788837754.699448:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 109 00000100:00100000:0.0:1788837754.699459:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+39:11340:x1875732012783872:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837754.699482:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837754.699506:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef77c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb6a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.699625:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef783 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.699640:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef783 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.699654:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef783 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837754.699666:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788837754.699773:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef77c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb6a expref: 42 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.699840:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef783 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb6a expref: 41 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.699849:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889b01a1f900) 00010000:00010000:0.0:1788837754.699853:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837754.699874:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791000, rc 0) 00000100:00100000:0.0:1788837754.699942:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+41:11340:x1875732012783872:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 484us (807us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1788837754.699949:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 109 00000100:00100000:1.0:1788837754.705651:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.705709:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837754.705809:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012784256 00000100:00100000:2.0:1788837754.705819:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012784256 00000100:00100000:2.0:1788837754.705876:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 110 00000100:00100000:2.0:1788837754.705886:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+41:11340:x1875732012784256:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837754.705909:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837754.705929:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325c00/0x57f6d4e926aef791 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb71 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.706035:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef798 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.706050:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef798 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.706061:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef798 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837754.706072:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788837754.706173:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325c00/0x57f6d4e926aef791 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb71 expref: 44 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.706190:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef798 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb71 expref: 43 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.706199:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889b01a1f900) 00010000:00010000:2.0:1788837754.706221:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788837754.706225:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324200, rc 0) 00000100:00100000:2.0:1788837754.706293:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+43:11340:x1875732012784256:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 409us (583us total) trans 4294967382 rc 0/0 00000100:00100000:2.0:1788837754.706301:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 110 00000100:00100000:3.0:1788837754.706832:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012784000 00000100:00100000:3.0:1788837754.706838:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012784000 00000100:00100000:3.0:1788837754.706883:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:3.0:1788837754.706892:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+43:2396:x1875732012784000:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837754.706903:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837754.706919:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef783 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb6a expref: 43 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.706931:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889b01a1f900) 00010000:00010000:3.0:1788837754.706935:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837754.706965:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+42:2396:x1875732012784000:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 74us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837754.706972:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:1.0:1788837754.713973:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837754.714075:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012784384 00000100:00100000:2.0:1788837754.714086:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012784384 00000100:00100000:2.0:1788837754.714149:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:2.0:1788837754.714160:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+8:2395:x1875732012784384:12345-192.168.201.3@tcp:1:lfs.0 00010000:00010000:2.0:1788837754.714201:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077604717/0x57f6d4e926aef7a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.714232:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 8 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.714240:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837754.714244:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837754.714249:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077604717/0x57f6d4e926aef7a6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.714286:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 8 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.714301:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 8 pid: 8544 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837754.714316:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1875732036975616:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837754.714448:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52600 going to sleep for 11 seconds 00000100:00100000:0.0:1788837754.717661:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.717828:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012784512 00000100:00100000:1.0:1788837754.717839:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012784512 00002000:00100000:1.0:1788837754.717888:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8899c36df800 x1875732012784512/t0(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:410/0 lens 504/0 e 0 to 0 dl 1788837765 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837754.717899:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c36df800 with x1875732012784512 ext(0->8) 00010000:00010000:1.0:1788837754.717910:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 9 pid: 8544 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.717927:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 9 pid: 8544 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837754.717935:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8899c36df800 00000100:00100000:1.0:1788837754.717970:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:1.0:1788837754.717981:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3a879e24-3b2f-4404-84c2-9101689d9315+9:2395:x1875732012784512:12345-192.168.201.3@tcp:4:lfs.0 00000100:00100000:2.0:1788837754.718841:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dc9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1875732036975616:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837754.718868:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000077604717/0x57f6d4e926aef7a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837754.719284:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3a879e24-3b2f-4404-84c2-9101689d9315+11:2395:x1875732012784512:12345-192.168.201.3@tcp:4:lfs.0 Request processed in 1303us (1630us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788837754.719294:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00002000:00100000:1.0:1788837754.719304:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8899c36df800 x1875732012784512/t4294967303(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:410/0 lens 504/448 e 0 to 0 dl 1788837765 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837754.719313:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c36df800 with x1875732012784512 ext(0->8) 00010000:00010000:1.0:1788837754.719320:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 11 pid: 8544 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837754.719331:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 11 pid: 8544 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837754.719360:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8899c36df800 00000100:00100000:3.0:1788837754.722313:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.722401:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012784640 00000100:00100000:0.0:1788837754.722411:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012784640 00010000:00010000:0.0:1788837754.722462:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 11 pid: 8544 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837754.722509:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:0.0:1788837754.722520:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+11:2396:x1875732012784640:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837754.722538:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788837754.722563:0:6509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788837754.722566:0:6509:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788837754 00002000:00010000:0.0:1788837754.722568:0:6509:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788837755 00002000:00010000:0.0:1788837754.722570:0:6509:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788837754 00002000:00010000:0.0:1788837754.722573:0:6509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788837754.722579:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 11 pid: 8544 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.722593:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 11 pid: 8544 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.722621:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f55647/0x57f6d4e926aef767 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb5c expref: 11 pid: 8544 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.722672:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837754.722677:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837754.722683:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077604717/0x57f6d4e926aef7a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.722693:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077604717/0x57f6d4e926aef7a6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.722723:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837754.722893:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000077604717/0x57f6d4e926aef7a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.722904:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077604717/0x57f6d4e926aef7a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.722924:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077604717/0x57f6d4e926aef7a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.722934:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077604717/0x57f6d4e926aef7a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.722942:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077604717/0x57f6d4e926aef7a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.722950:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837754.722955:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077604717/0x57f6d4e926aef7a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.722965:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077604717/0x57f6d4e926aef7a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.722990:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077604717/0x57f6d4e926aef7a6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.722998:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077604717/0x57f6d4e926aef7a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837754.723439:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+10:2396:x1875732012784640:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 916us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837754.723449:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:2.0:1788837754.723627:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+9:2395:x1875732012784384:12345-192.168.201.3@tcp:1:lfs.0 Request processed in 9469us (9668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837754.723646:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:1.0:1788837754.727574:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.727723:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012784896 00000100:00100000:0.0:1788837754.727734:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012784896 00000100:00100000:0.0:1788837754.727917:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:0.0:1788837754.727928:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8e79450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+42:11340:x1875732012784896:12345-192.168.201.3@tcp:35:lfs.0 00000004:00010000:0.0:1788837754.727991:0:6527:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef798 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb71 expref: 42 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837754.728361:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788837754.728400:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1788837754.729005:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:0.0:1788837754.729046:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.729063:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef752 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb4e expref: 46 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.729078:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.729115:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef752 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb4e expref: 46 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.729131:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef752 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb4e expref: 46 pid: 6524 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837754.729146:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6527:1875732036975744:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837754.729532:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac52303c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837754.733770:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837754.734160:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012785024 00000100:00100000:3.0:1788837754.734171:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012785024 00010000:00010000:3.0:1788837754.734283:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef752 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb4e expref: 47 pid: 6524 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837754.734328:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:3.0:1788837754.734473:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+47:2395:x1875732012785024:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837754.734492:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837754.734501:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef752 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb4e expref: 47 pid: 6524 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.734515:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef752 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb4e expref: 47 pid: 6524 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.734556:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889b01a1f900) 00010000:00010000:3.0:1788837754.734561:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.734570:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.734579:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.734600:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837754.734832:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef752 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb4e expref: 47 pid: 6524 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837754.734852:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6527:1875732036975744:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837754.734875:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.734883:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.734888:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837754.735002:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:0.0:1788837754.735129:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1788837754.735312:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+48:2395:x1875732012785024:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 973us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837754.735320:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:0.0:1788837754.740844:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875732036975872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788837754.740943:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837754.741003:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837754.741245:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036975872 00000100:00100000:3.0:1788837754.741254:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036975872 00000100:00100000:3.0:1788837754.741316:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788837754.741326:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6527:x1875732036975872:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788837754.741501:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6527:x1875732036975872:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 176us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837754.741509:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788837754.742111:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875732036975872:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788837754.742289:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:2.0:1788837754.742492:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dc9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875732036976000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788837754.742535:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837754.742615:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837754.742719:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036976000 00000100:00100000:3.0:1788837754.742725:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036976000 00000100:00100000:3.0:1788837754.742891:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788837754.742901:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6527:x1875732036976000:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788837754.743335:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6527:x1875732036976000:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 433us (796us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788837754.743369:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788837754.743566:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dc9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6527:1875732036976000:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788837754.743616:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1788837754.743666:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.743677:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.743685:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.743691:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837754.743695:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.743703:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.743718:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889b01a1f900) 00010000:00010000:0.0:1788837754.743721:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788837754.743726:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.743732:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7ad lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788837754.743867:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788837754.743933:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788837754.743947:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 371615170004ns, next at 372615167429ns, rc = 0 00000001:00080000:0.0:1788837754.743964:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:0.0:1788837754.744124:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889b01a1f900) 00010000:00010000:0.0:1788837754.744128:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788837754.744136:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aef798 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb71 expref: 50 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837754.744250:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8e79450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+49:11340:x1875732012784896:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 16324us (16685us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788837754.744259:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 26 00000020:00080000:0.0:1788837754.744263:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788837754.747525:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.747619:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012785152 00000100:00100000:0.0:1788837754.747630:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012785152 00000100:00100000:0.0:1788837754.747821:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 111 00000100:00100000:0.0:1788837754.747833:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+49:11340:x1875732012785152:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837754.747859:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837754.747880:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef7b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb78 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.747937:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef7b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb78 expref: 50 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.747952:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef7b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb78 expref: 50 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837754.747980:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:0.0:1788837754.747983:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837754.747987:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791000, rc 0) 00000100:00100000:0.0:1788837754.748036:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+50:11340:x1875732012785152:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 205us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837754.748055:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 111 00000100:00100000:2.0:1788837754.751260:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837754.751577:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012785408 00000100:00100000:1.0:1788837754.751588:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012785408 00000100:00100000:1.0:1788837754.751733:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:1.0:1788837754.751744:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+50:11340:x1875732012785408:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:1.0:1788837754.752018:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+51:11340:x1875732012785408:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 275us (827us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788837754.752026:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:1.0:1788837754.866185:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837754.866428:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012785536 00000100:00100000:2.0:1788837754.866439:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012785536 00000100:00100000:2.0:1788837754.866544:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 112 00000100:00100000:2.0:1788837754.866555:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+51:11350:x1875732012785536:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:2.0:1788837754.866645:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866662:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866675:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866703:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866711:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866717:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866829:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926aef7c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866837:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926aef7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866843:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926aef7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837754.866890:0:9317:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926aef7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866903:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866909:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866916:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866922:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837754.866926:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866941:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866954:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:2.0:1788837754.866957:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837754.866962:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866981:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.866995:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.867001:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.867006:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.867011:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837754.867014:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.867019:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.867025:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889b01a1f100) 00010000:00010000:2.0:1788837754.867028:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837754.867031:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.867046:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.867056:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926aef7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.867061:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926aef7c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.867067:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926aef7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.867071:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837754.867074:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926aef7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.867079:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926aef7c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.867087:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:2.0:1788837754.867089:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837754.867092:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926aef7c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.867098:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926aef7c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837754.867169:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+51:11350:x1875732012785536:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 615us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837754.867177:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 112 00000100:00100000:1.0:1788837754.930868:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837754.931290:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012785792 00000100:00100000:2.0:1788837754.931302:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012785792 00000100:00100000:2.0:1788837754.931384:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 113 00000100:00100000:2.0:1788837754.931394:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+51:11353:x1875732012785792:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837754.931650:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837754.931675:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926aef7d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb7f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.931752:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7d7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.931766:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.931799:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.931810:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.931817:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.931823:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.931925:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aef7e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.931934:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aef7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.931959:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aef7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837754.932096:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788837754.932178:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932185:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932191:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932213:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837754.932219:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932227:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932240:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:2.0:1788837754.932243:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837754.932247:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932253:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aef7d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932267:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932272:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932294:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932299:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837754.932303:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932309:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932880:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889b01a1f100) 00010000:00010000:2.0:1788837754.932883:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837754.932888:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932893:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef7de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932937:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926aef7d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb7f expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932950:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aef7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb7f expref: 53 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837754.932957:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:2.0:1788837754.932959:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837754.932961:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324800, rc 0) 00000100:00100000:2.0:1788837754.933231:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+53:11353:x1875732012785792:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 1837us (2373us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788837754.933253:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 113 00000100:00100000:1.0:1788837754.943237:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837754.943343:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012785920 00000100:00100000:3.0:1788837754.943355:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012785920 00000100:00100000:3.0:1788837754.943430:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 114 00000100:00100000:3.0:1788837754.943443:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+53:11353:x1875732012785920:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:3.0:1788837754.943528:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef7f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.943548:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.943560:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.943596:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.943602:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef7f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.943609:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef7f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.943615:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837754.943620:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef7f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.943627:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef7f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.943651:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:3.0:1788837754.943669:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837754.943675:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef7f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837754.943681:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef7f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837754.943761:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+53:11353:x1875732012785920:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 321us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837754.943769:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 114 00000100:00100000:1.0:1788837754.948655:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837754.948744:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012786176 00000100:00100000:0.0:1788837754.948755:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012786176 00000100:00100000:0.0:1788837754.948847:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:0.0:1788837754.948858:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+53:11353:x1875732012786176:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:0.0:1788837754.949121:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+54:11353:x1875732012786176:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 264us (489us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788837754.949130:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:1.0:1788837755.067923:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.068153:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012786432 00000100:00100000:0.0:1788837755.068163:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012786432 00000100:00100000:0.0:1788837755.068264:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 115 00000100:00100000:0.0:1788837755.068275:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+54:11363:x1875732012786432:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:0.0:1788837755.068309:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837755.068313:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788837755.068340:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef775 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb63 expref: 54 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.068360:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:0.0:1788837755.068365:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837755.068379:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7fa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb86 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.068501:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef801 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.068514:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.068540:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837755.068551:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788837755.068689:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef7fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb86 expref: 56 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.068703:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb86 expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.068711:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:0.0:1788837755.068713:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837755.068716:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791800, rc 0) 00000100:00100000:0.0:1788837755.068820:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+55:11363:x1875732012786432:12345-192.168.201.3@tcp:101:bash.0 Request processed in 546us (907us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788837755.068827:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 115 00000100:00100000:2.0:1788837755.075589:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837755.075641:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.075713:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012786560 00000100:00100000:3.0:1788837755.075723:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012786560 00000100:00100000:3.0:1788837755.075817:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 116 00000100:00100000:3.0:1788837755.075828:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+55:11363:x1875732012786560:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788837755.075851:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837755.075871:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef80f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb8d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.075904:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef816 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.075918:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.075929:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.076037:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef80f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb8d expref: 57 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.076056:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef816 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb8d expref: 56 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.076071:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:3.0:1788837755.076074:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788837755.076078:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17e00, rc 0) 00000100:00100000:3.0:1788837755.076126:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+56:11363:x1875732012786560:12345-192.168.201.3@tcp:101:bash.0 Request processed in 300us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837755.076133:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 116 00000100:00100000:0.0:1788837755.076700:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012786688 00000100:00100000:0.0:1788837755.076707:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012786688 00000100:00100000:0.0:1788837755.076759:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:0.0:1788837755.076767:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+56:2395:x1875732012786688:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837755.076797:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837755.076812:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef801 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb86 expref: 56 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.076824:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:0.0:1788837755.076828:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837755.076872:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+55:2395:x1875732012786688:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 105us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837755.076878:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:2.0:1788837755.080301:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.080530:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012786944 00000100:00100000:0.0:1788837755.080539:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012786944 00000100:00100000:0.0:1788837755.080599:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 117 00000100:00100000:0.0:1788837755.080609:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+55:11363:x1875732012786944:12345-192.168.201.3@tcp:36:bash.0 00010000:00010000:0.0:1788837755.080672:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837755.080699:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aef7e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb7f expref: 55 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.080717:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:0.0:1788837755.080722:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837755.080920:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef81d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.080935:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef81d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.080944:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef81d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837755.080988:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:0.0:1788837755.081012:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008465c0c2 reply state 000000008e9c6bb5 transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef81d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.081023:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef81d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.081030:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:0.0:1788837755.081045:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788837755.081048:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837755.081132:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+57:11363:x1875732012786944:12345-192.168.201.3@tcp:36:bash.0 Request processed in 524us (851us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788837755.081140:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 117 00000020:00080000:0.0:1788837755.081144:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788837755.095898:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.095985:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012787072 00000100:00100000:3.0:1788837755.095996:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012787072 00000100:00100000:3.0:1788837755.096061:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 118 00000100:00100000:3.0:1788837755.096072:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+57:11363:x1875732012787072:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788837755.096098:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837755.096121:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef824 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb94 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.096228:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef82b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.096244:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef82b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.096256:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef82b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837755.096305:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788837755.096310:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837755.096329:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef82b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.096376:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef824 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb94 expref: 59 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.096397:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef82b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb94 expref: 58 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.096405:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:3.0:1788837755.096408:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837755.096411:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17800, rc 0) 00000100:00100000:3.0:1788837755.096480:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+58:11363:x1875732012787072:12345-192.168.201.3@tcp:101:bash.0 Request processed in 409us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837755.096487:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 118 00000100:00100000:1.0:1788837755.100670:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.100761:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012787328 00000100:00100000:0.0:1788837755.100771:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012787328 00000100:00100000:0.0:1788837755.100853:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:0.0:1788837755.100863:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+58:11363:x1875732012787328:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:0.0:1788837755.101106:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+59:11363:x1875732012787328:12345-192.168.201.3@tcp:35:bash.0 Request processed in 243us (444us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788837755.101114:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:1.0:1788837755.158026:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.158127:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012787456 00000100:00100000:0.0:1788837755.158137:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012787456 00000100:00100000:0.0:1788837755.158211:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 119 00000100:00100000:0.0:1788837755.158222:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+59:11369:x1875732012787456:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837755.158244:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837755.158266:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef832 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eb9b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.158334:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef839 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.158349:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.158362:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837755.158440:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788837755.158445:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788837755.158466:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.158492:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef832 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb9b expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.158510:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef839 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb9b expref: 60 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.158518:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:0.0:1788837755.158521:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837755.158525:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791400, rc 0) 00000100:00100000:0.0:1788837755.158587:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+60:11369:x1875732012787456:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 367us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837755.158594:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 119 00000100:00100000:2.0:1788837755.162384:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.162526:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012787584 00000100:00100000:3.0:1788837755.162536:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012787584 00000100:00100000:3.0:1788837755.162598:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 120 00000100:00100000:3.0:1788837755.162610:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+60:11369:x1875732012787584:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788837755.162641:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837755.162663:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef840 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eba2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.162730:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef847 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.162744:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef847 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.162756:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef847 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.162821:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef84e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.162831:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef84e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.162838:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef84e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.162917:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef855 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.162926:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.162933:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837755.162978:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788837755.162982:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837755.163001:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163013:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163021:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef847 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163028:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef847 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163046:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef847 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163053:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837755.163057:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef847 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163066:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef847 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163078:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:3.0:1788837755.163081:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837755.163086:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef847 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163092:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef847 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163105:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef84e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163111:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef84e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163118:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef84e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163123:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837755.163126:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef84e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163143:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef84e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163152:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889b01a1f100) 00010000:00010000:3.0:1788837755.163155:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837755.163158:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef84e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163164:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef84e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163193:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef840 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eba2 expref: 62 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163472:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eba2 expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.163480:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:3.0:1788837755.163482:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837755.163485:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16600, rc 0) 00000100:00100000:3.0:1788837755.163600:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+61:11369:x1875732012787584:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 992us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837755.163607:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 120 00000100:00100000:1.0:1788837755.168561:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837755.168606:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.168708:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012787840 00000100:00100000:0.0:1788837755.168718:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012787840 00000100:00100000:0.0:1788837755.168772:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 121 00000100:00100000:0.0:1788837755.168798:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+61:11369:x1875732012787840:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837755.168819:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837755.168841:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef85c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eba9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.168950:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.168982:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef82b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb94 expref: 62 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.168990:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef855 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eba2 expref: 62 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.168998:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.169032:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eba2 expref: 62 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.169046:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef855 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eba2 expref: 62 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837755.169061:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36de300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036976128:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837755.169155:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef82b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb94 expref: 62 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.169164:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef82b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb94 expref: 62 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837755.169173:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036976256:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837755.169209:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adeb73900 going to sleep for 11 seconds 00000100:00100000:3.0:1788837755.172481:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012787968 00000100:00100000:3.0:1788837755.172496:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012787968 00010000:00010000:3.0:1788837755.172548:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef855 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eba2 expref: 63 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837755.172620:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 70 00000100:00100000:3.0:1788837755.172641:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+63:2395:x1875732012787968:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837755.172657:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837755.172665:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef855 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eba2 expref: 63 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.172678:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef855 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eba2 expref: 63 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.172702:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:3.0:1788837755.172708:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.172717:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.172723:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837755.172807:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+63:2395:x1875732012787968:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 177us (4199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837755.172815:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 70 00010000:00010000:0.0:1788837755.175606:0:6525:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.3@tcp) returned -22 from blocking AST (req@00000000ff7caa99 x1875732036976128) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef855 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eba2 expref: 62 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.175666:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef855 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eba2 expref: 62 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837755.175685:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36de300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036976128:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837755.175702:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036976256:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837755.175733:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:0.0:1788837755.175738:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.175747:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.175759:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837755.177348:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.177588:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012788096 00000100:00100000:0.0:1788837755.177598:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012788096 00010000:00010000:0.0:1788837755.177642:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef82b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb94 expref: 62 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837755.177684:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 71 00000100:00100000:0.0:1788837755.177693:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+62:2396:x1875732012788096:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837755.177707:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837755.177713:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef82b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb94 expref: 62 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.177743:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef82b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb94 expref: 62 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.177765:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef82b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb94 expref: 62 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.177815:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:0.0:1788837755.177821:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.177831:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.177840:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.177862:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837755.177924:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+61:2396:x1875732012788096:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 231us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837755.177933:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 71 00010000:00010000:1.0:1788837755.178323:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.178333:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837755.178360:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788837755.178498:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef85c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eba9 expref: 62 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.178517:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eba9 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.178524:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:1.0:1788837755.178526:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788837755.178529:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa791200, rc 0) 00000100:00100000:1.0:1788837755.178571:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+61:11369:x1875732012787840:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 9776us (10020us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788837755.178578:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 121 00000100:00100000:1.0:1788837755.182299:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.182421:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012788352 00000100:00100000:3.0:1788837755.182431:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012788352 00000100:00100000:3.0:1788837755.182508:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:3.0:1788837755.182520:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+61:11369:x1875732012788352:12345-192.168.201.3@tcp:103:lfs.0 00010000:00010000:3.0:1788837755.182536:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837755.182560:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef7b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb78 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.182594:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:3.0:1788837755.182599:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837755.182668:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+60:11369:x1875732012788352:12345-192.168.201.3@tcp:103:lfs.0 Request processed in 151us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837755.182676:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:2.0:1788837755.189048:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.189185:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012788480 00000100:00100000:3.0:1788837755.189207:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012788480 00000100:00100000:3.0:1788837755.189276:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:3.0:1788837755.189287:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+60:11369:x1875732012788480:12345-192.168.201.3@tcp:58:lfs.0 00010000:00010000:3.0:1788837755.189436:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef871 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.189455:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef871 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.189466:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef871 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788837755.189562:0:9317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788837755.189705:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+60:11369:x1875732012788480:12345-192.168.201.3@tcp:58:lfs.0 Request processed in 419us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837755.189713:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:1.0:1788837755.192746:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837755.192912:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012788608 00000100:00100000:2.0:1788837755.192922:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012788608 00000100:00100000:2.0:1788837755.193017:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 123 00000100:00100000:2.0:1788837755.193028:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+60:11369:x1875732012788608:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837755.193050:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837755.193070:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef878 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ebb0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.193128:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef871 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.193139:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef878 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebb0 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.193157:0:6524:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef871 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.193172:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef878 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebb0 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.193186:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:2.0:1788837755.193216:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837755.193221:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef878 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebb0 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.193230:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324c00, rc 0) 00000100:00100000:2.0:1788837755.193298:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+61:11369:x1875732012788608:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 271us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837755.193305:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 123 00010000:00010000:1.0:1788837755.577018:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788837755.641163:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837755.641174:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837755.641209:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788837755.641217:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788837755.641347:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dc9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875732036976384:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788837755.641577:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52300 going to sleep for 11 seconds 00000100:00100000:1.0:1788837755.651081:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.651318:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012788736 00000100:00100000:3.0:1788837755.651328:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012788736 00000100:00100000:3.0:1788837755.651408:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 124 00000100:00100000:3.0:1788837755.651418:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+62:11371:x1875732012788736:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788837755.651455:0:9317:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788837755.651634:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+62:11371:x1875732012788736:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 217us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837755.651642:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 124 00000100:00100000:2.0:1788837755.652259:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dc9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875732036976384:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788837755.660875:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837755.662991:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012788864 00000100:00100000:1.0:1788837755.663020:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012788864 00000100:00100000:1.0:1788837755.663104:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 125 00000100:00100000:1.0:1788837755.663114:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+61:11371:x1875732012788864:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788837755.663208:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef87f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663226:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef87f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663257:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef87f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663275:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef886 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663283:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef886 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663289:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef886 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663310:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef88d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663319:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef88d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663325:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef88d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837755.663369:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788837755.663373:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837755.663386:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef88d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663397:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef87f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663404:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef87f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663420:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef87f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663426:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837755.663430:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef87f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663438:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef87f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663449:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aded2c400) 00010000:00010000:1.0:1788837755.663452:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837755.663456:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef87f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663462:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef87f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663474:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef886 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663480:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef886 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663486:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef886 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663491:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837755.663494:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef886 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663509:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef886 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663516:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff889b01a1fa00) 00010000:00010000:1.0:1788837755.663519:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837755.663522:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef886 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663527:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef886 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663541:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef88d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663547:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef88d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663552:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef88d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663557:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837755.663560:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef88d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663566:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef88d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663573:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:1.0:1788837755.663575:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837755.663578:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef88d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.663594:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aef88d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837755.664766:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+61:11371:x1875732012788864:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 Request processed in 1643us (3890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837755.664791:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 125 00000100:00100000:1.0:1788837755.680452:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.680531:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012789120 00000100:00100000:3.0:1788837755.680542:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012789120 00000100:00100000:3.0:1788837755.680605:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 126 00000100:00100000:3.0:1788837755.680616:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+61:11371:x1875732012789120:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837755.680652:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837755.680686:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef894 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ebb7 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.680838:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef89b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.680854:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.680866:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837755.680888:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788837755.680977:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef89b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.680985:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef89b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.680992:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef89b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.680997:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837755.681008:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef89b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.681016:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef89b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.681027:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:3.0:1788837755.681030:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788837755.681045:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef89b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.681052:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef89b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.681092:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef894 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebb7 expref: 63 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.681102:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aded2c400) 00010000:00010000:3.0:1788837755.681104:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837755.681108:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef894 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebb7 expref: 63 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.681118:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16a00, rc 0) 00000100:00100000:3.0:1788837755.681182:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+62:11371:x1875732012789120:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 567us (740us total) trans 4294967400 rc 301/301 00000100:00100000:3.0:1788837755.681200:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 126 00000100:00100000:2.0:1788837755.685416:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.685523:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012789248 00000100:00100000:0.0:1788837755.685534:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012789248 00000100:00100000:0.0:1788837755.685595:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 127 00000100:00100000:0.0:1788837755.685606:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+62:11371:x1875732012789248:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788837755.685649:0:6524:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788837755.685825:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+62:11371:x1875732012789248:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 221us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837755.685849:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 127 00000100:00100000:1.0:1788837755.690821:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.690911:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012789504 00000100:00100000:3.0:1788837755.690922:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012789504 00000100:00100000:3.0:1788837755.690977:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 128 00000100:00100000:3.0:1788837755.690986:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+62:11371:x1875732012789504:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837755.691023:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837755.691026:0:9317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788837755.691067:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef839 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb9b expref: 62 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.691086:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:3.0:1788837755.691091:0:9317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837755.691105:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef8a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ebbe expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837755.691498:0:9317:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788837755.691639:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef8b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.691653:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.691663:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.691729:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef8a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebbe expref: 64 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.691746:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebbe expref: 63 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.691753:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351000) 00010000:00010000:3.0:1788837755.691756:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837755.691764:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17c00, rc 0) 00000100:00100000:3.0:1788837755.691881:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+63:11371:x1875732012789504:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 894us (1110us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788837755.691889:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 128 00000100:00100000:3.0:1788837755.696249:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.706213:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012789760 00000100:00100000:0.0:1788837755.706233:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012789760 00000100:00100000:0.0:1788837755.706316:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 129 00000100:00100000:0.0:1788837755.706327:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+63:11371:x1875732012789760:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837755.706382:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837755.706419:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aef8b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebbe expref: 63 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706440:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351000) 00010000:00010000:0.0:1788837755.706451:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837755.706474:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef8be lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706489:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef8be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706499:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef8be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706536:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef8c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x26ba1b58 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706544:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef8c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x26ba1b58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706550:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef8c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x26ba1b58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706595:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef8be lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706615:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef8be lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706888:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef8be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706894:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837755.706899:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef8be lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706907:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef8be lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706916:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:0.0:1788837755.706919:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837755.706923:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef8be lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706929:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791400/0x57f6d4e926aef8be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706940:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef8c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x26ba1b58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706946:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef8c5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x26ba1b58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706951:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef8c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x26ba1b58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706956:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837755.706966:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef8c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x26ba1b58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706973:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef8c5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x26ba1b58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706982:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x26ba1b58 (ffff889aded2c100) 00010000:00010000:0.0:1788837755.706984:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837755.706988:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef8c5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x26ba1b58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.706993:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791000/0x57f6d4e926aef8c5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x26ba1b58 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837755.707108:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+62:11371:x1875732012789760:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 781us (10870us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788837755.707116:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 129 00000100:00100000:1.0:1788837755.710564:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.710911:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012789888 00000100:00100000:3.0:1788837755.710920:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012789888 00000100:00100000:3.0:1788837755.710980:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:3.0:1788837755.710991:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+62:11371:x1875732012789888:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837755.711009:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837755.711030:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef8cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ebc5 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.711079:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef8d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.711093:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.711103:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.711226:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef8cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebc5 expref: 64 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.711245:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef8d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebc5 expref: 63 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.711253:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351200) 00010000:00010000:3.0:1788837755.711263:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788837755.711267:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17800, rc 0) 00000100:00100000:3.0:1788837755.711332:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+63:11371:x1875732012789888:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 343us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837755.711338:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:1.0:1788837755.714960:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.715415:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012790144 00000100:00100000:0.0:1788837755.715428:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012790144 00000100:00100000:0.0:1788837755.715490:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 131 00000100:00100000:0.0:1788837755.715500:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+63:11371:x1875732012790144:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837755.715596:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef8da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.715611:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.715631:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837755.715804:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1788837755.715828:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372587050778ns, next at 373587048343ns, rc = 0 00000004:00010000:0.0:1788837755.715876:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac47cc96 reply state 00000000aa56ca3c transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef8da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.715888:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef8da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.715895:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351200) 00010000:00010000:0.0:1788837755.715898:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788837755.715901:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837755.715995:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+65:11371:x1875732012790144:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 496us (1047us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1788837755.716002:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 131 00000100:00100000:1.0:1788837755.726598:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.726811:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012790272 00000100:00100000:3.0:1788837755.726821:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012790272 00000100:00100000:3.0:1788837755.726878:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 132 00000100:00100000:3.0:1788837755.726887:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+65:11371:x1875732012790272:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837755.726909:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837755.726929:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef8e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ebcc expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.726986:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef8e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebcc expref: 66 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.727000:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef8e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebcc expref: 66 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.727030:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351200) 00010000:00010000:3.0:1788837755.727271:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837755.727276:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16600, rc 0) 00000100:00100000:3.0:1788837755.731318:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+66:11371:x1875732012790272:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 4418us (4715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837755.731333:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 132 00000100:00100000:3.0:1788837755.737646:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837755.737818:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012790400 00000100:00100000:1.0:1788837755.737829:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012790400 00000100:00100000:1.0:1788837755.737905:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:1.0:1788837755.737915:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+8:2393:x1875732012790400:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788837755.738163:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837755.743488:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+9:2393:x1875732012790400:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 5556us (5834us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788837755.743504:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:0.0:1788837755.748096:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837755.748267:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012790656 00000100:00100000:2.0:1788837755.748277:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012790656 00000100:00100000:2.0:1788837755.748332:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:2.0:1788837755.748341:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+66:11371:x1875732012790656:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788837755.748577:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+67:11371:x1875732012790656:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 236us (490us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788837755.748585:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:3.0:1788837755.753099:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.753443:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012790912 00000100:00100000:0.0:1788837755.753453:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012790912 00000100:00100000:0.0:1788837755.753518:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 133 00000100:00100000:0.0:1788837755.753529:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+67:11371:x1875732012790912:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788837755.753656:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+67:11371:x1875732012790912:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 128us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837755.753663:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 133 00000100:00100000:3.0:1788837755.756515:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837755.756620:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012791040 00000100:00100000:1.0:1788837755.756630:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012791040 00000100:00100000:1.0:1788837755.756694:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 134 00000100:00100000:1.0:1788837755.756704:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+67:11371:x1875732012791040:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837755.756723:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837755.756743:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef8e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ebd3 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.756897:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef8ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.756913:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef8ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.756924:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef8ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837755.756972:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837755.756992:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef8ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.757017:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8600/0x57f6d4e926aef8e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebd3 expref: 69 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.757049:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef8ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebd3 expref: 68 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.757058:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351200) 00010000:00010000:1.0:1788837755.757061:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788837755.757065:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8c00, rc 0) 00000100:00100000:1.0:1788837755.757134:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+68:11371:x1875732012791040:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 431us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837755.757141:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 134 00000100:00100000:2.0:1788837755.761330:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.761438:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012791168 00000100:00100000:0.0:1788837755.761449:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012791168 00000100:00100000:0.0:1788837755.761514:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:0.0:1788837755.761527:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+9:2393:x1875732012791168:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837755.761547:0:8544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837755.761573:0:8544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926aef8f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ebda expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788837755.761626:0:8544:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7f7c, blocks: 0x0 00010000:00010000:0.0:1788837755.761652:0:8544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1788837755.761657:0:8544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837755.761667:0:8544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926aef8f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebda expref: 10 pid: 8544 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.761696:0:8544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926aef8f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebda expref: 10 pid: 8544 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.761712:0:8544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9aa00, rc 0) 00000100:00100000:0.0:1788837755.761949:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+10:2393:x1875732012791168:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 423us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837755.761957:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:2.0:1788837755.766235:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.766345:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012791424 00000100:00100000:0.0:1788837755.766358:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012791424 00000100:00100000:0.0:1788837755.766430:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 135 00000100:00100000:0.0:1788837755.766441:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+68:11371:x1875732012791424:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788837755.766577:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+68:11371:x1875732012791424:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 128us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837755.766586:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 135 00000100:00100000:2.0:1788837755.769963:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.770270:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012791552 00000100:00100000:3.0:1788837755.770281:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012791552 00000100:00100000:3.0:1788837755.770341:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:3.0:1788837755.770352:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+10:11371:x1875732012791552:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837755.770372:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837755.770402:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aec91a5a/0x57f6d4e926aef8fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ebe1 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.770439:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926aef8f6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebda expref: 11 pid: 8544 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.770450:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837755.770454:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837755.770459:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aec91a5a/0x57f6d4e926aef8fd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe1 expref: 11 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.770499:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926aef8f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebda expref: 11 pid: 8544 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.770516:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926aef8f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebda expref: 11 pid: 8544 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837755.770532:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3daed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875732036976512:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788837755.770633:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4e63d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837755.774276:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3daed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875732036976512:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837755.774333:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aec91a5a/0x57f6d4e926aef8fd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe1 expref: 11 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.774355:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16a00, rc 0) 00000100:00100000:3.0:1788837755.774417:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+11:11371:x1875732012791552:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 4066us (4464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837755.774425:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:2.0:1788837755.776299:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.776531:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012791680 00000100:00100000:0.0:1788837755.776541:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012791680 00010000:00010000:0.0:1788837755.776583:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926aef8f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebda expref: 11 pid: 8544 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837755.776648:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:0.0:1788837755.776658:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+11:2395:x1875732012791680:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837755.776682:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837755.776705:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926aef8f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebda expref: 11 pid: 8544 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.776718:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926aef8f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebda expref: 11 pid: 8544 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.776742:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0be693e/0x57f6d4e926aef8f6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebda expref: 11 pid: 8544 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.776761:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837755.776765:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837755.776773:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aec91a5a/0x57f6d4e926aef8fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe1 expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.776826:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aec91a5a/0x57f6d4e926aef8fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe1 expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.776862:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000aec91a5a/0x57f6d4e926aef8fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe1 expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837755.776876:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6509:1875732036976640:192.168.201.3@tcp:105: 00000100:00100000:0.0:1788837755.776970:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adeb730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837755.780869:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6509:1875732036976640:192.168.201.3@tcp:105: 00010000:00010000:0.0:1788837755.780899:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837755.780957:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+10:2395:x1875732012791680:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 4299us (4667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837755.780970:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:1.0:1788837755.784903:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.785101:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012791808 00000100:00100000:3.0:1788837755.785111:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012791808 00002000:00100000:3.0:1788837755.785159:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8899c3d9df80 x1875732012791808/t0(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:411/0 lens 504/0 e 0 to 0 dl 1788837766 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788837755.785171:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c3d9df80 with x1875732012791808 ext(0->12) 00002000:00010000:3.0:1788837755.785178:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8899c3d9df80 00000100:00100000:3.0:1788837755.785273:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:3.0:1788837755.785283:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3a879e24-3b2f-4404-84c2-9101689d9315+10:2393:x1875732012791808:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788837755.786649:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3a879e24-3b2f-4404-84c2-9101689d9315+12:2393:x1875732012791808:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 Request processed in 1360us (1747us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788837755.786663:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00002000:00100000:3.0:1788837755.786674:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8899c3d9df80 x1875732012791808/t4294967309(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:411/0 lens 504/448 e 0 to 0 dl 1788837766 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788837755.786693:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c3d9df80 with x1875732012791808 ext(0->12) 00002000:00010000:3.0:1788837755.786698:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8899c3d9df80 00000100:00100000:2.0:1788837755.789995:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837755.790161:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012791936 00000100:00100000:1.0:1788837755.790173:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012791936 00000100:00100000:1.0:1788837755.790265:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 136 00000100:00100000:1.0:1788837755.790275:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+68:11371:x1875732012791936:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788837755.793478:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:2.0:1788837755.793497:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788837755.793544:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:1.0:1788837755.793648:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef602 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793664:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef602 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793673:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef602 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793689:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837755.793694:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef602 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793703:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef602 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793722:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff889aded2cd00) 00010000:00010000:1.0:1788837755.793725:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837755.793731:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef602 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793737:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790800/0x57f6d4e926aef602 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793765:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef6aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793772:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef6aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793827:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef6aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793832:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837755.793835:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef6aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793841:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef6aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793850:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff889aded2c200) 00010000:00010000:1.0:1788837755.793852:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837755.793855:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef6aa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793861:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef6aa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793877:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef728 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793883:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef728 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793889:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef728 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793894:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837755.793897:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef728 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793913:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef728 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793921:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889b01a1f100) 00010000:00010000:1.0:1788837755.793923:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837755.793926:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef728 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793931:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aef728 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793942:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef74b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793948:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef74b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793953:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef74b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793958:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837755.793960:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef74b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793965:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef74b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793972:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889b01a1f100) 00010000:00010000:1.0:1788837755.793974:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837755.793977:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef74b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.793988:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef74b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794003:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef81d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794009:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef81d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794014:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef81d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794019:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa790200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837755.794022:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef81d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794027:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef81d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837755.794280:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837755.794298:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036976768:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788837755.794368:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837755.794407:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837755.794416:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036976896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788837755.794437:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837755.794542:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:1.0:1788837755.794545:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837755.794549:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef81d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794555:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790200/0x57f6d4e926aef81d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794567:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef8da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794573:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef8da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794585:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef8da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794590:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837755.794593:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef8da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794600:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef8da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794608:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351200) 00010000:00010000:1.0:1788837755.794610:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788837755.794613:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef8da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794619:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791800/0x57f6d4e926aef8da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837755.794641:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036976768 00000100:00100000:1.0:1788837755.794648:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036976768 00000100:00100000:1.0:1788837755.794713:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036976896 00000100:00100000:1.0:1788837755.794716:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036976896 00000100:00100000:1.0:1788837755.794737:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788837755.794745:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1875732036976768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788837755.794771:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1788837755.794821:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aabeeca/0x57f6d4e926aef904 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794841:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926aef6b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb39 expref: 11 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794863:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788837755.794868:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837755.794872:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aabeeca/0x57f6d4e926aef904 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794902:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926aef6b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb39 expref: 11 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.794917:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926aef6b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb39 expref: 11 pid: 8441 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837755.794930:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875732036977024:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788837755.794998:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adf4eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837755.795016:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788837755.795023:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1875732036976896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788837755.795146:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788837755.795150:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788837756 00002000:00010000:1.0:1788837755.795153:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788837755.795155:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788837756 -> 1788837756 00002000:00010000:1.0:1788837755.795157:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788837755.795217:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3daf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3651:x1875732036976896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (777us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788837755.795224:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:1.0:1788837755.795289:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8899c3dac000/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788837755.795301:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036976896:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1788837755.795922:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837755.799652:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.799694:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012792064 00000100:00100000:3.0:1788837755.799702:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012792064 00010000:00010000:3.0:1788837755.799747:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926aef6b8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb39 expref: 12 pid: 8441 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837755.799816:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 73 00000100:00100000:3.0:1788837755.799826:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+12:2396:x1875732012792064:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837755.799840:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837755.799846:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926aef6b8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb39 expref: 12 pid: 8441 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.799859:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926aef6b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb39 expref: 12 pid: 8441 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.799886:0:9528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837755.799890:0:9528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837755.799896:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000aabeeca/0x57f6d4e926aef904 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.799904:0:9528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aabeeca/0x57f6d4e926aef904 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.799935:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837755.799984:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+12:2396:x1875732012792064:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 159us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837755.799991:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 73 00010000:00010000:1.0:1788837755.800992:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926aef6b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb39 expref: 11 pid: 8441 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837755.801012:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875732036977024:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788837755.801047:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000aabeeca/0x57f6d4e926aef904 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.801058:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000aabeeca/0x57f6d4e926aef904 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.801066:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000aabeeca/0x57f6d4e926aef904 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.801075:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aabeeca/0x57f6d4e926aef904 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.801084:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000aabeeca/0x57f6d4e926aef904 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.801106:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788837755.801301:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3648:x1875732036976768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6555us (6931us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788837755.801311:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1788837755.801338:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837755.801344:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000aabeeca/0x57f6d4e926aef904 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.801363:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837755.801367:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000aabeeca/0x57f6d4e926aef904 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.801376:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000aabeeca/0x57f6d4e926aef904 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.801393:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000aabeeca/0x57f6d4e926aef904 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.801412:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aabeeca/0x57f6d4e926aef904 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.801429:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837755.801431:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837755.801432:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788837755.801462:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8899c3daed80/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788837755.801468:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036976768:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788837755.803009:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837755.803103:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036977152:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788837755.803174:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837755.803326:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036977152 00000100:00100000:0.0:1788837755.803335:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036977152 00000100:00100000:0.0:1788837755.803758:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788837755.803770:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af76fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1875732036977152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788837755.804111:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:0.0:1788837755.804146:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f7f7a, atime: 0x6a9f7f7b, ctime: 0x6a9f7f7a, blocks: 0x8 00010000:00010000:0.0:1788837755.804153:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0be693e/0x57f6d4e926aef90b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.804169:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1788837755.804173:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837755.804180:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0be693e/0x57f6d4e926aef90b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788837755.804274:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788837755.804316:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0be693e/0x57f6d4e926aef90b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.804329:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0be693e/0x57f6d4e926aef90b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.804336:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0be693e/0x57f6d4e926aef90b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.804482:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788837755.804686:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af76fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3650:x1875732036977152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 908us (1501us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788837755.804694:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000020:00080000:2.0:1788837755.805020:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff889b01a52a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788837755.805026:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889afa73e700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff889b01a52600 00000020:00080000:2.0:1788837755.805030:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889afa73e900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff889ad9b31a00 00000004:00080000:2.0:1788837755.805070:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788837755.805107:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff889b01a520c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788837755.805110:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889af7610800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff889b01a52d80 00000020:00080000:2.0:1788837755.805113:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889af7610300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8899c3d45800 00000020:00080000:2.0:1788837755.805136:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788837755.805177:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788837755.805298:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+16:11371:x1875732012791936:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 Request processed in 15023us (15313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837755.805306:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 136 00000004:00080000:3.0:1788837755.805971:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8899c36dc380/2, rc 0, transno 4294967305 00000100:00100000:3.0:1788837755.805980:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036977152:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788837755.808423:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.808534:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012792192 00000100:00100000:0.0:1788837755.808544:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012792192 00000100:00100000:0.0:1788837755.808605:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:0.0:1788837755.808615:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3a879e24-3b2f-4404-84c2-9101689d9315+11:2394:x1875732012792192:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788837755.810319:0:10392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837755.810331:0:10392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0be693e/0x57f6d4e926aef90b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.810345:0:10392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9aa00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837755.810349:0:10392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0be693e/0x57f6d4e926aef90b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.810383:0:10392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0be693e/0x57f6d4e926aef90b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.810410:0:10392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0be693e/0x57f6d4e926aef90b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.810418:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0be693e/0x57f6d4e926aef90b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.810442:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837755.810444:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837755.810447:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788837755.811260:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1788837755.811271:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1788837755.811451:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3a879e24-3b2f-4404-84c2-9101689d9315+6:2394:x1875732012792192:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 Request processed in 2833us (3031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837755.811461:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:2.0:1788837755.814821:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837755.814923:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012792448 00000100:00100000:1.0:1788837755.814933:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012792448 00000100:00100000:1.0:1788837755.814985:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 137 00000100:00100000:1.0:1788837755.814995:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+16:11371:x1875732012792448:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788837755.815060:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837755.815086:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef8ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebd3 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.815104:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351200) 00010000:00010000:1.0:1788837755.815109:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837755.815149:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef912 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.815164:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef912 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.815175:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef912 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837755.815297:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb81337a reply state 000000005c336789 transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef912 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.815310:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef912 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.815317:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351200) 00010000:00010000:1.0:1788837755.815320:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788837755.815322:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788837755.815415:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+17:11371:x1875732012792448:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 421us (646us total) trans 4294967404 rc 0/0 00000100:00100000:1.0:1788837755.815423:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 137 00000100:00100000:3.0:1788837755.818229:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837755.818378:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012792576 00000100:00100000:1.0:1788837755.818388:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012792576 00000100:00100000:1.0:1788837755.818458:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:1.0:1788837755.818468:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:2396:x1875732012792576:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788837755.818626:0:8544:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788837755.818629:0:8544:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788837756 -> 1788837755 00002000:00010000:1.0:1788837755.818631:0:8544:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788837755 00002000:00010000:1.0:1788837755.818634:0:8544:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788837756 -> 1788837755 00002000:00010000:1.0:1788837755.818636:0:8544:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788837755.819445:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:2396:x1875732012792576:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 973us (1222us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788837755.819455:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:3.0:1788837755.822028:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837755.822241:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012792832 00000100:00100000:2.0:1788837755.822251:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012792832 00000100:00100000:2.0:1788837755.822307:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 138 00000100:00100000:2.0:1788837755.822316:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+17:11371:x1875732012792832:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788837755.822387:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.822414:0:9317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef8d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebc5 expref: 17 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.822438:0:9317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.822476:0:9317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef8d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebc5 expref: 17 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.822491:0:9317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef8d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebc5 expref: 17 pid: 9317 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837755.822506:0:9317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d64000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036977280:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837755.822590:0:9317:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837755.825772:0:9317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d64000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036977280:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837755.825974:0:9317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837755.827137:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.827398:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012792960 00000100:00100000:0.0:1788837755.827408:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012792960 00010000:00010000:0.0:1788837755.827452:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef8d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebc5 expref: 18 pid: 9317 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837755.827491:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 74 00000100:00100000:0.0:1788837755.827501:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+18:2396:x1875732012792960:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837755.827516:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837755.827523:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef8d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebc5 expref: 18 pid: 9317 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.827535:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef8d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebc5 expref: 18 pid: 9317 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.827574:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef8d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebc5 expref: 18 pid: 9317 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.827610:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351200) 00010000:00010000:0.0:1788837755.827616:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.827632:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.827641:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.827661:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837755.827725:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+17:2396:x1875732012792960:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 224us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837755.827733:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 74 00010000:00010000:2.0:1788837755.829545:0:9317:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.829561:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.829602:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.829609:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.829735:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.829743:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837755.829747:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.829771:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.829845:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351200) 00010000:00010000:2.0:1788837755.829847:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788837755.829852:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.829858:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aef919 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837755.829987:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+16:11371:x1875732012792832:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 Request processed in 7669us (7966us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788837755.829997:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 138 00000100:00100000:2.0:1788837755.832599:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.832666:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012793088 00000100:00100000:0.0:1788837755.832685:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012793088 00000100:00100000:0.0:1788837755.832745:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:0.0:1788837755.832756:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:2394:x1875732012793088:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788837755.832834:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d0a33225/0x57f6d4e926aef920 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.832856:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aec91a5a/0x57f6d4e926aef8fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe1 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.832865:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837755.832870:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837755.832875:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a33225/0x57f6d4e926aef920 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.832925:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aec91a5a/0x57f6d4e926aef8fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe1 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.832941:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aec91a5a/0x57f6d4e926aef8fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe1 expref: 7 pid: 8441 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837755.832956:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875732036977408:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837755.836006:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adeb730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837755.839943:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875732036977408:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837755.839975:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d0a33225/0x57f6d4e926aef920 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837755.841094:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.841358:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012793216 00000100:00100000:3.0:1788837755.841367:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012793216 00010000:00010000:3.0:1788837755.841419:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aec91a5a/0x57f6d4e926aef8fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe1 expref: 8 pid: 8441 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837755.841463:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 75 00000100:00100000:3.0:1788837755.841488:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+8:2396:x1875732012793216:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837755.841504:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837755.841526:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aec91a5a/0x57f6d4e926aef8fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe1 expref: 8 pid: 8441 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.841539:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aec91a5a/0x57f6d4e926aef8fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe1 expref: 8 pid: 8441 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.841562:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aec91a5a/0x57f6d4e926aef8fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe1 expref: 8 pid: 8441 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.841578:0:9528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837755.841582:0:9528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837755.841587:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0a33225/0x57f6d4e926aef920 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.841597:0:9528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a33225/0x57f6d4e926aef920 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.841634:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837755.841698:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:2396:x1875732012793216:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 211us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837755.841705:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 75 00010000:00010000:1.0:1788837755.842491:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d0a33225/0x57f6d4e926aef920 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.842502:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0a33225/0x57f6d4e926aef920 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.842523:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d0a33225/0x57f6d4e926aef920 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.842530:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a33225/0x57f6d4e926aef920 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.842537:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0a33225/0x57f6d4e926aef920 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.842544:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837755.842548:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0a33225/0x57f6d4e926aef920 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.842555:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0a33225/0x57f6d4e926aef920 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.842568:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0a33225/0x57f6d4e926aef920 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.842585:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0a33225/0x57f6d4e926aef920 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837755.842667:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2394:x1875732012793088:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 Request processed in 9912us (10075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837755.842683:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:1.0:1788837755.848688:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.848883:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012793472 00000100:00100000:0.0:1788837755.848894:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012793472 00000100:00100000:0.0:1788837755.848956:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 139 00000100:00100000:0.0:1788837755.848965:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+16:11371:x1875732012793472:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788837755.849051:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.849068:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef816 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb8d expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.849077:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.849129:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef816 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb8d expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.849143:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef816 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb8d expref: 16 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837755.849157:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036977536:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837755.849245:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adeb730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837755.852288:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.852412:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036977536:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837755.852439:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837755.853153:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012793600 00000100:00100000:3.0:1788837755.853163:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012793600 00010000:00010000:3.0:1788837755.853228:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef816 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb8d expref: 17 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837755.853304:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 76 00000100:00100000:3.0:1788837755.853314:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+17:2396:x1875732012793600:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837755.853328:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837755.853336:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef816 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb8d expref: 17 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.853347:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef816 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb8d expref: 17 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.853369:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef816 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eb8d expref: 17 pid: 6526 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.853385:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:3.0:1788837755.853547:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef878 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebb0 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.853558:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.853566:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.853573:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837755.853604:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837755.853672:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+16:2396:x1875732012793600:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 360us (1393us total) trans 0 rc 0/0 00010000:00010000:0.0:1788837755.854157:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.854166:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.854353:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.854367:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef8e1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebcc expref: 17 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.854375:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.854420:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef8e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebcc expref: 17 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.854444:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef8e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebcc expref: 17 pid: 9317 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837755.854460:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036977664:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837755.854536:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adeb73900 going to sleep for 11 seconds 00000100:00100000:3.0:1788837755.855027:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 76 00000100:00100000:0.0:1788837755.858543:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036977664:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837755.858575:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837755.860441:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.860656:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012793728 00000100:00100000:0.0:1788837755.860665:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012793728 00010000:00010000:0.0:1788837755.860714:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef8e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebcc expref: 17 pid: 9317 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837755.860758:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 77 00000100:00100000:0.0:1788837755.860768:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+17:2396:x1875732012793728:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837755.860811:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837755.860819:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef8e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebcc expref: 17 pid: 9317 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.860832:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef8e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebcc expref: 17 pid: 9317 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.860855:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef8e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ebcc expref: 17 pid: 9317 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.860891:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351200) 00010000:00010000:0.0:1788837755.860897:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.860906:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.860914:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.860937:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837755.860997:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+16:2396:x1875732012793728:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 230us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837755.861004:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 77 00010000:00010000:1.0:1788837755.861380:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.861390:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788837755.861509:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1788837755.861626:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:1.0:1788837755.861661:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1788837755.861742:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6524:1875732036977792:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788837755.861862:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837755.862195:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4dc93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837755.863826:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036977792 00000100:00100000:3.0:1788837755.863839:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036977792 00000100:00100000:2.0:1788837755.864103:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788837755.864113:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1875732036977792:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788837755.864274:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1875732036977792:12345-0@lo:1000:mdt00_000.0 Request processed in 162us (2412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837755.864282:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788837755.864434:0:6524:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788837755.864440:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:1.0:1788837755.864461:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8899c3dac000, transno 4294967310 00000004:00080000:1.0:1788837755.864478:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8899c3daed80, transno 4294967311 00000100:00100000:1.0:1788837755.864486:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6524:1875732036977792:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788837755.864654:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:1.0:1788837755.864762:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6524:1875732036977920:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788837755.864830:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837755.864858:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adf4ea540 going to sleep for 11 seconds 00000100:00100000:0.0:1788837755.864985:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036977920 00000100:00100000:0.0:1788837755.864991:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036977920 00000100:00100000:0.0:1788837755.865040:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788837755.865049:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1875732036977920:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788837755.865162:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6524:x1875732036977920:12345-0@lo:1000:mdt00_000.0 Request processed in 115us (332us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788837755.865169:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788837755.865356:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6524:1875732036977920:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788837755.865392:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865403:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865411:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865418:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837755.865422:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865430:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865446:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351200) 00010000:00010000:1.0:1788837755.865449:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788837755.865454:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865460:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aef92e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865484:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef871 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865490:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef871 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865504:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef871 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865509:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837755.865512:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef871 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865519:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef871 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865528:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:1.0:1788837755.865530:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788837755.865537:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef878 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebb0 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865549:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef878 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebb0 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865559:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef878 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebb0 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837755.865583:0:6524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef878 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebb0 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837755.865594:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036978048:192.168.201.3@tcp:105: 00000100:00100000:1.0:1788837755.865678:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad2b7f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788837755.869982:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036978048:192.168.201.3@tcp:105: 00010000:00010000:2.0:1788837755.870013:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef871 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870024:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef871 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870090:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aef935 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870105:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aef935 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870116:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aef935 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870126:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aef935 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870133:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aef935 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870140:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aef935 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870146:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837755.870150:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aef935 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870158:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aef935 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870170:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:2.0:1788837755.870172:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837755.870176:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aef935 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870182:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aef935 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870217:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870224:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870231:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870236:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837755.870239:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870245:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870254:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:2.0:1788837755.870256:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788837755.870259:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.870265:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aef927 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837755.870422:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+19:11371:x1875732012793472:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 21456us (21742us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788837755.870433:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 139 00000020:00080000:2.0:1788837755.870440:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788837755.870827:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837755.870833:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837755.871375:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788837755.871384:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788837755.874486:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837755.874569:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012793856 00000100:00100000:2.0:1788837755.874579:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012793856 00000100:00100000:2.0:1788837755.874659:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:2.0:1788837755.874669:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+19:11369:x1875732012793856:12345-192.168.201.3@tcp:49:lfs.0 00000100:00100000:2.0:1788837755.874845:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+19:11369:x1875732012793856:12345-192.168.201.3@tcp:49:lfs.0 Request processed in 176us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837755.874854:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:3.0:1788837755.875961:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837755.875988:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012794112 00000100:00100000:2.0:1788837755.875996:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012794112 00000100:00100000:2.0:1788837755.876136:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:2.0:1788837755.876147:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+19:11371:x1875732012794112:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788837755.876413:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788837755.876443:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:2.0:1788837755.876475:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aef93c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.876490:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aef93c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.876500:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aef93c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.876508:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aef93c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.876514:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aef93c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.876519:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aef93c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.876544:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788837755.876638:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8e7bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+21:11371:x1875732012794112:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 493us (683us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788837755.876645:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 32 00000020:00080000:2.0:1788837755.876650:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788837755.876770:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837755.876802:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aef93c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.876810:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837755.876814:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aef93c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.876822:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aef93c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.876836:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351200) 00010000:00010000:0.0:1788837755.876839:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788837755.876843:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aef93c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.876848:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aef93c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.876861:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837755.876863:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837755.876864:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837755.879282:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837755.879326:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012794368 00000100:00100000:3.0:1788837755.879334:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012794368 00000100:00100000:3.0:1788837755.879403:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 140 00000100:00100000:3.0:1788837755.879415:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+21:11369:x1875732012794368:12345-192.168.201.3@tcp:58:lfs.0 00000040:00080000:3.0:1788837755.879570:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788837755.879644:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+21:11369:x1875732012794368:12345-192.168.201.3@tcp:58:lfs.0 Request processed in 231us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837755.879653:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 140 00000100:00100000:3.0:1788837755.915773:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837755.916004:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012794496 00000100:00100000:2.0:1788837755.916017:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012794496 00000100:00100000:2.0:1788837755.916094:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 141 00000100:00100000:2.0:1788837755.916103:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+21:11373:x1875732012794496:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837755.916130:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837755.916152:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aef943 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ebe8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.916229:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef94a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.916244:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef94a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.916255:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef94a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.916268:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aef951 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.916275:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aef951 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.916290:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aef951 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.916358:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325c00/0x57f6d4e926aef958 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.916386:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eba9 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.916395:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325c00/0x57f6d4e926aef958 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.916429:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eba9 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.916443:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eba9 expref: 22 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837755.916455:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d67100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036978176:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837755.916554:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837755.920449:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837755.920766:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012794752 00000100:00100000:1.0:1788837755.920822:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012794752 00000100:00100000:0.0:1788837755.921018:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:0.0:1788837755.921030:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+23:6165:x1875732012794752:12345-192.168.201.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788837755.921281:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+24:6165:x1875732012794752:12345-192.168.201.3@tcp:35:ldlm_bl.0 Request processed in 252us (840us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788837755.921289:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:2.0:1788837755.922171:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d67100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036978176:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837755.922214:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325c00/0x57f6d4e926aef958 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837755.924160:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837755.924523:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012794880 00000100:00100000:0.0:1788837755.924533:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012794880 00010000:00010000:0.0:1788837755.924573:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eba9 expref: 24 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837755.924648:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 78 00000100:00100000:0.0:1788837755.924658:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3daf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+24:2395:x1875732012794880:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837755.924898:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837755.924907:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eba9 expref: 24 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.924921:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eba9 expref: 24 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.924955:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa791200/0x57f6d4e926aef863 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eba9 expref: 24 pid: 6525 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.924970:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:0.0:1788837755.924976:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325c00/0x57f6d4e926aef958 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.924986:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325c00/0x57f6d4e926aef958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.924994:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325c00/0x57f6d4e926aef958 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837755.925023:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837755.925080:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3daf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+23:2395:x1875732012794880:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 423us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837755.925088:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 78 00010000:00010000:2.0:1788837755.925149:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325c00/0x57f6d4e926aef958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925159:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325c00/0x57f6d4e926aef958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837755.925228:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788837755.925233:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788837755.925252:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325c00/0x57f6d4e926aef958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925278:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325c00/0x57f6d4e926aef958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925287:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef94a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925293:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef94a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925299:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef94a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925306:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837755.925310:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef94a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925318:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef94a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925327:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:2.0:1788837755.925330:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837755.925335:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef94a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925341:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aef94a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925351:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aef951 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925357:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aef951 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925368:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aef951 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925372:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837755.925375:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aef951 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925382:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aef951 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925399:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff889aded28b00) 00010000:00010000:2.0:1788837755.925402:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837755.925405:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aef951 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925411:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aef951 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925444:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aef943 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe8 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925458:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325c00/0x57f6d4e926aef958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe8 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837755.925465:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:2.0:1788837755.925467:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837755.925470:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1325c00, rc 0) 00000100:00100000:2.0:1788837755.925497:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+22:11373:x1875732012794496:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 9396us (9736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837755.925512:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 141 00000100:00100000:2.0:1788837756.346849:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036978304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837756.346915:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837756.346980:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837756.346986:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036978432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837756.347007:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837756.347139:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036978304 00000100:00100000:0.0:1788837756.347153:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036978304 00000100:00100000:0.0:1788837756.347216:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036978432 00000100:00100000:0.0:1788837756.347220:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036978432 00000100:00100000:0.0:1788837756.347237:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788837756.347253:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036978304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837756.347278:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1788837756.347326:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036978304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837756.347333:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788837756.347350:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788837756.347356:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036978432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837756.347366:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1788837756.347402:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036978432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837756.347409:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788837756.347449:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036978432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837756.347463:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036978304:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788837756.347715:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788837756.602947:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837756.687446:0:14266:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837756.687455:0:14266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837756.687485:0:14266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788837756.687492:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1788837756.860813:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1788837756.860836:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:0.0:1788837756.923209:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837756.923221:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837756.923276:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788837756.923287:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788837756.923432:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875732036978560:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788837756.923566:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24fa900 going to sleep for 11 seconds 00000100:00100000:0.0:1788837756.933603:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875732036978560:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788837756.941063:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837756.947150:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012795008 00000100:00100000:3.0:1788837756.947178:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012795008 00000100:00080000:2.0:1788837756.947330:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837756.947385:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 142 00000100:00100000:3.0:1788837756.947400:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+22:11385:x1875732012795008:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788837756.947439:0:6526:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788837756.947590:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+22:11385:x1875732012795008:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 195us (6537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837756.947615:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 142 00000100:00100000:3.0:1788837756.954143:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837756.959500:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012795264 00000100:00100000:1.0:1788837756.959528:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012795264 00000100:00100000:1.0:1788837756.959599:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 143 00000100:00100000:1.0:1788837756.959610:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+22:11385:x1875732012795264:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837756.959631:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837756.959651:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef95f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ebef expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837756.959772:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef966 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837756.959807:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef966 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837756.959818:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef966 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837756.959829:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788837756.959941:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aef95f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebef expref: 25 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837756.959959:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef966 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebef expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837756.959967:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:1.0:1788837756.959970:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837756.959974:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8c00, rc 0) 00000100:00100000:1.0:1788837756.960046:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+24:11385:x1875732012795264:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 438us (5913us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788837756.960071:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 143 00000100:00100000:1.0:1788837756.964931:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837756.964969:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837756.965028:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012795520 00000100:00100000:3.0:1788837756.965039:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012795648 00000100:00100000:0.0:1788837756.965040:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012795520 00000100:00100000:3.0:1788837756.965047:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012795648 00000100:00100000:3.0:1788837756.965126:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:0.0:1788837756.965126:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 144 00000100:00100000:3.0:1788837756.965144:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+25:2395:x1875732012795648:12345-192.168.201.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788837756.965146:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+25:11385:x1875732012795520:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788837756.965162:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837756.965199:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef966 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebef expref: 25 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837756.965220:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:3.0:1788837756.965225:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837756.965236:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aef974 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837756.965255:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aef974 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837756.965268:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aef974 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837756.965283:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+24:2395:x1875732012795648:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 145us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837756.965291:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00010000:00010000:0.0:1788837756.965433:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aef974 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837756.965442:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aef974 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837756.965449:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aef974 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837756.965456:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837756.965460:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aef974 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837756.965468:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aef974 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837756.965478:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:0.0:1788837756.965482:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788837756.965499:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aef974 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837756.965506:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aef974 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837756.965631:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+24:11385:x1875732012795520:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 492us (707us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788837756.965639:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 144 00000040:00080000:3.0:1788837756.965869:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837756.965874:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837756.966361:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788837756.966369:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788837756.976103:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837756.977511:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012795904 00000100:00100000:0.0:1788837756.977806:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012795904 00000100:00100000:0.0:1788837756.978035:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:0.0:1788837756.978047:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+24:11385:x1875732012795904:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788837756.978372:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+25:11385:x1875732012795904:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 326us (2278us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788837756.978381:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 34 00010000:00010000:1.0:1788837757.629353:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837757.882080:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036978688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837757.882163:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837757.882222:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837757.882228:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036978816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837757.882248:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837757.882277:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036978688 00000100:00100000:3.0:1788837757.882284:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036978688 00000100:00100000:3.0:1788837757.882424:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036978816 00000100:00100000:3.0:1788837757.882428:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036978816 00000100:00100000:3.0:1788837757.882449:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788837757.882459:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036978688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837757.882528:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837757.882732:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036978688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 274us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837757.882740:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788837757.882756:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788837757.882762:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036978816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788837757.882771:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837757.882810:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036978816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837757.882815:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788837757.882868:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036978816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837757.882878:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1788837757.882884:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:3.0:1788837757.882904:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8899c3344a80, transno 4294967302 00000004:00080000:3.0:1788837757.882913:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1788837757.882924:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8899c36dc380, transno 4294967305 00000100:00100000:3.0:1788837757.882932:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036978688:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788837757.883052:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837757.890721:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036978944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837757.890827:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837757.891097:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036979200:0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.891207:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837757.891232:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036979712:0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.891255:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837757.891291:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036980224:0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.891315:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837757.891324:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036978944 00000100:00100000:2.0:1788837757.891334:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036978944 00000100:00100000:0.0:1788837757.891335:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788837757.891343:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036979328:0@lo:400:kworker.0 00000100:00100000:2.0:1788837757.891384:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788837757.891394:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036978944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788837757.891427:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788837757.891459:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837757.891486:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036979840:0@lo:400:kworker.0 00000100:00100000:2.0:1788837757.891488:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036978944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837757.891500:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788837757.891517:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837757.891519:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036979328 00000100:00100000:2.0:1788837757.891524:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036979328 00000100:00100000:2.0:1788837757.891546:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788837757.891553:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036979328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.891560:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036979200 00000100:00100000:0.0:1788837757.891566:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036979200 00000100:00100000:0.0:1788837757.891600:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036979712 00000100:00100000:0.0:1788837757.891604:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036979712 00000100:00100000:2.0:1788837757.891612:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036979328:12345-0@lo:400:kworker.0 Request processed in 58us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837757.891620:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788837757.891635:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036980224 00000100:00100000:0.0:1788837757.891640:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036980224 00000100:00100000:0.0:1788837757.891660:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788837757.891666:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036979328:0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.891669:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036979200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.891718:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036979200:12345-0@lo:400:kworker.0 Request processed in 52us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837757.891726:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788837757.891740:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788837757.891746:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036979712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.891773:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036979712:12345-0@lo:400:kworker.0 Request processed in 27us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837757.891796:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788837757.891808:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788837757.891814:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036980224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.891841:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036980224:12345-0@lo:400:kworker.0 Request processed in 28us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837757.891857:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788837757.891879:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036979840 00000100:00100000:0.0:1788837757.891882:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036979840 00000100:00100000:0.0:1788837757.891908:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788837757.891922:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c337c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036979840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.891954:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c337c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036979840:12345-0@lo:400:kworker.0 Request processed in 34us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837757.891960:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788837757.891984:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036979072:0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.892013:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837757.892035:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036979584:0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.892062:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837757.892079:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036980096:0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.892100:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837757.892119:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788837757.892126:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036979456:0@lo:400:kworker.0 00000100:00100000:2.0:1788837757.892247:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036979840:0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.892902:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837757.892918:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036979968:0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.892941:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837757.892976:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036979072 00000100:00100000:0.0:1788837757.892981:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036979072 00000100:00100000:0.0:1788837757.893013:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788837757.893018:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036979072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.893058:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036979072:12345-0@lo:400:kworker.0 Request processed in 39us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837757.893065:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788837757.893091:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036979968 00000100:00100000:0.0:1788837757.893096:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036979968 00000100:00100000:0.0:1788837757.893125:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788837757.893132:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875732036979968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.893186:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875732036979968:12345-0@lo:400:kworker.0 Request processed in 55us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837757.893193:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788837757.893217:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036979584 00000100:00100000:0.0:1788837757.893220:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036979584 00000100:00100000:0.0:1788837757.893236:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036980096 00000100:00100000:0.0:1788837757.893239:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036980096 00000100:00100000:0.0:1788837757.893249:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036979456 00000100:00100000:0.0:1788837757.893251:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036979456 00000100:00100000:0.0:1788837757.893260:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788837757.893265:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036979584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.893292:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036979584:12345-0@lo:400:kworker.0 Request processed in 27us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837757.893298:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788837757.893693:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788837757.893702:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c31b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036980096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.893732:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c31b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036980096:12345-0@lo:400:kworker.0 Request processed in 33us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837757.893738:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788837757.893749:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788837757.893754:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036979456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.893795:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036979456:12345-0@lo:400:kworker.0 Request processed in 21us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837757.893802:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:0.0:1788837757.893823:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837757.893828:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837757.893830:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788837757.893886:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036978944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837757.893915:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036979456:0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.893924:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036979968:0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.893931:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036979072:0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.893940:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036979584:0@lo:400:kworker.0 00000100:00100000:0.0:1788837757.893948:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036980096:0@lo:400:kworker.0 00000100:00100000:2.0:1788837757.895971:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036979200:0@lo:400:kworker.0 00010000:00080000:2.0:1788837757.895995:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c36dd500 x1875732036979712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837757.896004:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036979712:0@lo:400:kworker.0 00010000:00080000:2.0:1788837757.896018:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c36de680 x1875732036980224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837757.896026:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036980224:0@lo:400:kworker.0 00000040:00080000:1.0:1788837758.643658:0:14318:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837758.643668:0:14318:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837758.643701:0:14318:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788837758.643707:0:14318:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788837758.648949:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837758.845547:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837758.846041:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012796160 00000100:00100000:3.0:1788837758.846053:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012796160 00000100:00100000:3.0:1788837758.846172:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 145 00000100:00100000:3.0:1788837758.846184:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+25:11405:x1875732012796160:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788837758.846235:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837758.846269:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef97b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ebf6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.846394:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031400/0x57f6d4e926aef982 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.846409:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031400/0x57f6d4e926aef982 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.846421:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031400/0x57f6d4e926aef982 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837758.846432:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788837758.846543:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aef97b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebf6 expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.846561:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031400/0x57f6d4e926aef982 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebf6 expref: 27 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.846570:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:3.0:1788837758.846573:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788837758.846577:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0031400, rc 0) 00000100:00100000:3.0:1788837758.846635:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+27:11405:x1875732012796160:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 454us (1097us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788837758.846642:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 145 00000100:00080000:3.0:1788837758.846665:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837758.851081:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837758.851119:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012796288 00000100:00100000:3.0:1788837758.851149:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012796288 00000100:00100000:3.0:1788837758.851276:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 146 00000100:00100000:3.0:1788837758.851288:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+27:11405:x1875732012796288:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:3.0:1788837758.851649:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef990 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.851736:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.851749:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.851870:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.851878:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef990 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.851885:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef990 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.851891:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0030a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837758.851896:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef990 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.851902:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef990 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.851915:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:3.0:1788837758.851918:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837758.851922:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef990 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837758.851940:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aef990 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837758.852015:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+27:11405:x1875732012796288:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 728us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837758.852022:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 146 00000100:00100000:2.0:1788837758.906049:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837758.906227:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036980352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837758.906301:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837758.906532:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036980352 00000100:00100000:0.0:1788837758.906541:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036980352 00000100:00100000:0.0:1788837758.906608:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788837758.906618:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036980352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837758.906665:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788837758.906721:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036980352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837758.906729:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788837758.907194:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036980352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837758.932020:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837758.932148:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012796416 00000100:00100000:1.0:1788837758.932159:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012796416 00000100:00080000:3.0:1788837758.932357:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837758.932411:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:1.0:1788837758.932422:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012796416:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:1.0:1788837758.932439:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837758.932459:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cd02cf4/0x57f6d4e926aef997 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ebfd expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837758.932485:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f7f7b, atime: 0x6a9f7f7b, ctime: 0x6a9f7f7b, blocks: 0x8 00010000:00010000:1.0:1788837758.932505:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1788837758.932510:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837758.932521:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cd02cf4/0x57f6d4e926aef997 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebfd expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837758.932540:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002cd02cf4/0x57f6d4e926aef997 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebfd expref: 7 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837758.932635:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8600, rc 0) 00000100:00100000:1.0:1788837758.932693:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012796416:12345-192.168.201.3@tcp:101:cat.0 Request processed in 273us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837758.932701:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:3.0:1788837758.936903:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837758.936969:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012796544 00000100:00100000:1.0:1788837758.936982:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012796544 00002000:00100000:1.0:1788837758.937040:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff889affbd9c00 x1875732012796544/t0(0) o3->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:414/0 lens 488/0 e 0 to 0 dl 1788837769 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837758.937051:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889affbd9c00 with x1875732012796544 ext(0->4095) 00002000:00010000:1.0:1788837758.937056:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff889affbd9c00 00000100:00100000:1.0:1788837758.937515:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:1.0:1788837758.937527:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:2396:x1875732012796544:12345-192.168.201.3@tcp:3:cat.0 00000100:00100000:1.0:1788837758.937910:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:2396:x1875732012796544:12345-192.168.201.3@tcp:3:cat.0 Request processed in 384us (1014us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788837758.937918:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00002000:00100000:1.0:1788837758.937925:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff889affbd9c00 x1875732012796544/t0(0) o3->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:414/0 lens 488/4536 e 0 to 0 dl 1788837769 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788837758.937935:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889affbd9c00 with x1875732012796544 ext(0->4095) 00002000:00010000:1.0:1788837758.937938:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff889affbd9c00 00000100:00100000:3.0:1788837758.966631:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837758.966686:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837758.966726:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837758.966731:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012796800 00000100:00100000:0.0:1788837758.966742:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012796800 00000100:00100000:3.0:1788837758.966758:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837758.966835:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012797056 00000100:00100000:0.0:1788837758.966839:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012797056 00000100:00100000:2.0:1788837758.966867:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012796672 00000100:00100000:0.0:1788837758.966868:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 278 00000100:00100000:2.0:1788837758.966871:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012796672 00000100:00100000:0.0:1788837758.966877:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012796800:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837758.966900:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 379 00000100:00100000:2.0:1788837758.966907:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012796672:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837758.966971:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012796800:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 95us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837758.966980:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 278 00000100:00100000:0.0:1788837758.966999:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 279 00000100:00100000:0.0:1788837758.967014:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012797056:12345-192.168.201.3@tcp:400:kworker.0 00000100:00080000:1.0:1788837758.970472:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837758.970483:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837758.970995:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012796672:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 4079us (4259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837758.971000:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012797056:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 3986us (4313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837758.971008:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 379 00000100:00100000:0.0:1788837758.971009:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 279 00000100:00100000:0.0:1788837758.971058:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012796928 00000100:00100000:0.0:1788837758.971066:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012796928 00000100:00100000:0.0:1788837758.971145:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 118 00000100:00100000:0.0:1788837758.971155:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012796928:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837758.971216:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012796928:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 63us (4457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837758.971223:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 118 00000100:00080000:1.0:1788837758.971416:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837758.972483:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837758.973413:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012797184 00000100:00100000:1.0:1788837758.973428:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012797184 00000100:00100000:1.0:1788837758.973593:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 280 00000100:00100000:1.0:1788837758.973604:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012797184:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837758.973938:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012797184:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 335us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837758.973947:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 280 00000100:00080000:3.0:1788837758.978018:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788837759.677853:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837760.710929:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788837760.954565:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1788837760.954604:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff889ac4dc9d80 refcount 2 committed 0 result 0 batchid 4 00010000:00010000:0.0:1788837760.954604:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef912 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788837760.954610:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889afa6b9d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff889ac4dc93c0 00010000:00010000:0.0:1788837760.954616:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef912 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788837760.954621:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889afa6b9700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff889ad115a800 00010000:00010000:0.0:1788837760.954624:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef912 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837760.954631:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837760.954636:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef912 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837760.954645:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef912 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788837760.954652:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1788837760.954662:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8899c3351200) 00010000:00010000:0.0:1788837760.954670:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837760.954676:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef912 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837760.954682:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef912 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788837760.954753:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788837760.954862:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1788837760.955497:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1788837760.955506:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:1.0:1788837761.478111:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036980480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837761.478201:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837761.478279:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837761.478287:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036980608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837761.478310:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837761.478343:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036980480 00000100:00100000:3.0:1788837761.478354:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036980480 00000100:00100000:3.0:1788837761.478414:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036980608 00000100:00100000:3.0:1788837761.478418:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036980608 00000100:00100000:3.0:1788837761.478444:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788837761.478454:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036980480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788837761.478488:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788837761.478558:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036980480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837761.478566:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1788837761.478584:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837761.478598:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788837761.478607:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036980608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837761.478618:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788837761.478647:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036980608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837761.478653:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788837761.481132:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1788837761.481144:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1788837761.481178:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036980608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837761.481199:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036980480:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788837761.721064:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788837762.104926:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837762.104937:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837762.104957:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788837762.104964:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788837762.617477:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788837762.745565:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837763.001129:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036980736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837763.001205:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837763.001441:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837763.001448:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036980864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837763.001473:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837763.001509:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036980736 00000100:00100000:3.0:1788837763.001516:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036980736 00000100:00100000:3.0:1788837763.001567:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036980864 00000100:00100000:3.0:1788837763.001570:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036980864 00000100:00100000:3.0:1788837763.001601:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788837763.001609:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036980736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837763.001638:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837763.001681:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036980736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837763.001688:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788837763.001704:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788837763.001711:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036980864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788837763.001720:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837763.001742:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036980864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837763.001765:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788837763.001825:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036980864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837763.001837:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036980736:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788837763.002005:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837763.004848:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837763.004869:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036981248:0@lo:400:kworker.0 00000100:00100000:3.0:1788837763.004944:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837763.005001:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036981248 00000100:00100000:3.0:1788837763.005007:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036981248 00000100:00100000:3.0:1788837763.005056:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788837763.005076:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036981248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837763.005128:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036981248:12345-0@lo:400:kworker.0 Request processed in 64us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837763.005135:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788837763.005177:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036981248:0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.005446:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036980992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837763.005517:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837763.005538:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036981504:0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.005561:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837763.005577:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036982016:0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.005610:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837763.005747:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788837763.005753:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036981120:0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.005803:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837763.005825:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036981632:0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.005841:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837763.005853:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036982144:0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.005868:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837763.005894:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036980992 00000100:00100000:1.0:1788837763.005897:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036980992 00000100:00100000:1.0:1788837763.005923:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036981632 00000100:00100000:1.0:1788837763.005925:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036981632 00000100:00100000:1.0:1788837763.005936:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788837763.005942:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036980992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788837763.005966:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788837763.005997:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036980992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837763.006004:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788837763.006016:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788837763.006022:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036981632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.006046:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036981632:12345-0@lo:400:kworker.0 Request processed in 25us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837763.006052:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788837763.006079:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036981504 00000100:00100000:1.0:1788837763.006083:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036981504 00000100:00100000:1.0:1788837763.006105:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788837763.006110:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036981504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.006135:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036981504:12345-0@lo:400:kworker.0 Request processed in 25us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837763.006150:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788837763.006166:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036982016 00000100:00100000:1.0:1788837763.006169:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036982016 00000100:00100000:1.0:1788837763.006196:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036982144 00000100:00100000:1.0:1788837763.006198:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036982144 00000100:00100000:1.0:1788837763.006218:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788837763.006225:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036982016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.006256:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036982016:12345-0@lo:400:kworker.0 Request processed in 32us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837763.006262:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788837763.006285:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788837763.006291:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036982144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.006317:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036982144:12345-0@lo:400:kworker.0 Request processed in 27us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837763.006324:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788837763.006340:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036981120 00000100:00100000:1.0:1788837763.006344:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036981120 00000100:00100000:1.0:1788837763.006369:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788837763.006374:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036981120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.006400:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036981120:12345-0@lo:400:kworker.0 Request processed in 25us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837763.006405:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:1.0:1788837763.006445:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837763.006462:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036981120:0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.006471:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036981632:0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.006488:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036982144:0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.006499:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036980992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837763.006508:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036981504:0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.006516:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036982016:0@lo:400:kworker.0 00000100:00100000:3.0:1788837763.006714:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa6ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036981376:0@lo:400:kworker.0 00000100:00100000:3.0:1788837763.006761:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837763.006804:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036981888:0@lo:400:kworker.0 00000100:00100000:3.0:1788837763.006823:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837763.006837:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac618f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036982400:0@lo:400:kworker.0 00000100:00100000:3.0:1788837763.006853:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837763.006867:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788837763.006872:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036981760:0@lo:400:kworker.0 00000100:00100000:3.0:1788837763.006887:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837763.006908:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732036982272:0@lo:400:kworker.0 00000100:00100000:3.0:1788837763.006926:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837763.006944:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036981888 00000100:00100000:3.0:1788837763.006948:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036981888 00000100:00100000:3.0:1788837763.006969:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036982400 00000100:00100000:3.0:1788837763.006971:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036982400 00000100:00100000:3.0:1788837763.006983:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788837763.006989:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036981888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837763.007020:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036981888:12345-0@lo:400:kworker.0 Request processed in 31us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837763.007026:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788837763.007036:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036981760 00000100:00100000:3.0:1788837763.007038:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036981760 00000100:00100000:3.0:1788837763.007049:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036982272 00000100:00100000:3.0:1788837763.007051:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036982272 00000100:00100000:3.0:1788837763.007072:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788837763.007079:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036982400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837763.007105:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036982400:12345-0@lo:400:kworker.0 Request processed in 28us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837763.007111:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788837763.007122:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788837763.007128:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036981760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837763.007152:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036981760:12345-0@lo:400:kworker.0 Request processed in 25us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837763.007157:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788837763.007166:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788837763.007171:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732036982272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837763.007201:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732036982272:12345-0@lo:400:kworker.0 Request processed in 29us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837763.007206:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:3.0:1788837763.007224:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837763.007227:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837763.007251:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036981760:0@lo:400:kworker.0 00000100:00100000:3.0:1788837763.007259:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732036982272:0@lo:400:kworker.0 00010000:00080000:3.0:1788837763.007280:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ad17af480 x1875732036981888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837763.007290:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036981888:0@lo:400:kworker.0 00010000:00080000:3.0:1788837763.007298:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ac618f800 x1875732036982400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837763.007305:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac618f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036982400:0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.008171:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036981376 00000100:00100000:1.0:1788837763.008178:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036981376 00000100:00100000:1.0:1788837763.008216:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788837763.008224:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036981376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837763.008279:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036981376:12345-0@lo:400:kworker.0 Request processed in 56us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837763.008286:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788837763.008516:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa6ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036981376:0@lo:400:kworker.0 00010000:00010000:0.0:1788837763.769978:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837764.026802:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036982528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837764.026882:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837764.027015:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036982528 00000100:00100000:0.0:1788837764.027024:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036982528 00000100:00100000:0.0:1788837764.027104:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788837764.027114:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036982528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837764.027148:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788837764.027204:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036982528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837764.027211:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788837764.027332:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036982528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837764.030903:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837764.030991:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012797312 00000100:00100000:3.0:1788837764.031001:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012797312 00000100:00100000:3.0:1788837764.031136:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 147 00000100:00100000:3.0:1788837764.031150:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+13:11058:x1875732012797312:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788837764.031263:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+13:11058:x1875732012797312:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 Request processed in 119us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837764.031270:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 147 00000100:00080000:1.0:1788837764.031336:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837764.043843:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837764.045123:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012797440 00000100:00100000:3.0:1788837764.045150:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012797440 00000100:00100000:3.0:1788837764.045210:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 148 00000100:00100000:3.0:1788837764.045221:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:11058:x1875732012797440:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788837764.045307:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:11058:x1875732012797440:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 Request processed in 91us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837764.045312:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 148 00000100:00080000:1.0:1788837764.045519:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837764.048085:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837764.048200:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012797696 00000100:00100000:0.0:1788837764.048211:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012797696 00000100:00100000:0.0:1788837764.048316:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:0.0:1788837764.048326:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+13:11058:x1875732012797696:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788837764.048579:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+14:11058:x1875732012797696:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 253us (501us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788837764.048602:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:3.0:1788837764.088917:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837764.088965:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837764.088993:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837764.089030:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837764.089088:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837764.089121:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012798336 00000100:00100000:3.0:1788837764.089132:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012798336 00000100:00100000:3.0:1788837764.089210:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012798208 00000100:00100000:3.0:1788837764.089213:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012798208 00000100:00100000:3.0:1788837764.089245:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 287 00000100:00100000:1.0:1788837764.089289:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012798080 00000100:00100000:1.0:1788837764.089294:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012798080 00000100:00100000:1.0:1788837764.089341:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012797952 00000100:00100000:1.0:1788837764.089346:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012797952 00000100:00100000:0.0:1788837764.089359:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 121 00000100:00100000:2.0:1788837764.089409:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012797824 00000100:00100000:2.0:1788837764.089413:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012797824 00000100:00100000:2.0:1788837764.089443:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 381 00000100:00100000:2.0:1788837764.089450:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012797824:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837764.089514:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012797824:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 65us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837764.089521:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 381 00000100:00100000:0.0:1788837764.089815:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012798080:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837764.089857:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012798080:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 489us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837764.089960:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012798336:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837764.089990:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012798336:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 34us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837764.092017:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 288 00000100:00100000:2.0:1788837764.092055:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac618f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012798208:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837764.092130:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac618f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012798208:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 101us (3041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837764.092139:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 288 00000100:00080000:2.0:1788837764.092677:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837764.092685:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837764.092688:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837764.092692:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837764.093547:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 287 00000100:00100000:1.0:1788837764.097325:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:1.0:1788837764.097355:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa6ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:2396:x1875732012797952:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837764.097452:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa6ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:2396:x1875732012797952:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 111us (8420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837764.097460:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:0.0:1788837764.103004:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 121 00000100:00100000:2.0:1788837764.478753:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837764.478927:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012798464 00000100:00100000:3.0:1788837764.478938:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012798464 00000100:00100000:3.0:1788837764.479051:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 149 00000100:00100000:3.0:1788837764.479073:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:11865:x1875732012798464:12345-192.168.201.3@tcp:101:lsof.0 00010000:00010000:3.0:1788837764.479094:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837764.479120:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef99e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec04 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837764.479219:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef9a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837764.479233:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837764.479729:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837764.479820:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788837764.479825:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837764.479865:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef9a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837764.479890:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef99e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec04 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837764.479908:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec04 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837764.479916:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ad8ad9400) 00010000:00010000:3.0:1788837764.479918:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837764.479922:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16600, rc 0) 00000100:00100000:3.0:1788837764.480050:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:11865:x1875732012798464:12345-192.168.201.3@tcp:101:lsof.0 Request processed in 990us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837764.480058:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 149 00010000:00010000:2.0:1788837764.802137:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837765.820737:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837766.586043:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036982656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837766.586057:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837766.586077:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad1162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036982784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837766.586183:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837766.587120:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837766.592013:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036982656 00000100:00100000:3.0:1788837766.592030:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036982656 00000100:00100000:3.0:1788837766.592184:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036982784 00000100:00100000:3.0:1788837766.592188:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036982784 00000100:00080000:2.0:1788837766.595117:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837766.595923:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788837766.595943:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036982656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837766.595980:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788837766.596206:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036982656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 272us (10023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837766.596215:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788837766.597082:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788837766.597097:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036982784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837766.597115:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788837766.597176:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036982784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (10058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837766.597182:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788837766.597262:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad1162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036982784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837766.610011:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036982656:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788837766.841023:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788837767.100227:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:2.0:1788837767.100245:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788837767.100327:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788837767.100340:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788837767.865018:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837768.121851:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837768.121874:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad1161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036982912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837768.121960:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837768.122036:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036982912 00000100:00100000:3.0:1788837768.122044:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036982912 00000100:00100000:3.0:1788837768.122097:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788837768.122107:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036982912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837768.122134:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837768.122177:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036982912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837768.122183:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1788837768.122203:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837768.122253:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad1161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036982912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837768.123852:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036983040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837768.123906:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837768.124102:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad1160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036983424:0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.124142:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837768.124161:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7f59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036983936:0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.124194:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837768.124220:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036984448:0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.124240:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837768.124259:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788837768.124265:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad1162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036983296:0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.124286:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837768.124309:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036983808:0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.124329:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837768.124358:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732036984320:0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.124379:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837768.124614:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036983424 00000100:00100000:3.0:1788837768.124622:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036983424 00000100:00100000:3.0:1788837768.124670:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788837768.124678:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036983424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.124733:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036983424:12345-0@lo:400:kworker.0 Request processed in 55us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837768.124739:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788837768.124761:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036983936 00000100:00100000:3.0:1788837768.124764:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036983936 00000100:00100000:3.0:1788837768.124819:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036984448 00000100:00100000:3.0:1788837768.124823:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036984448 00000100:00100000:3.0:1788837768.124836:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036983296 00000100:00100000:3.0:1788837768.124838:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036983296 00000100:00100000:3.0:1788837768.124847:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036983808 00000100:00100000:3.0:1788837768.124849:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036983808 00000100:00100000:3.0:1788837768.124870:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788837768.124875:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036983936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.124907:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875732036983936:12345-0@lo:400:kworker.0 Request processed in 32us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837768.124913:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788837768.124922:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036984320 00000100:00100000:3.0:1788837768.124925:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036984320 00000100:00100000:3.0:1788837768.124940:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788837768.124944:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036984448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.124971:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875732036984448:12345-0@lo:400:kworker.0 Request processed in 26us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837768.124986:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788837768.124998:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788837768.125003:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036983296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.125029:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732036983296:12345-0@lo:400:kworker.0 Request processed in 26us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837768.125035:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788837768.125047:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788837768.125053:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036983808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.125078:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875732036983808:12345-0@lo:400:kworker.0 Request processed in 26us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837768.125084:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788837768.125094:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788837768.125099:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732036984320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.125123:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732036984320:12345-0@lo:400:kworker.0 Request processed in 24us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837768.125135:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:3.0:1788837768.125166:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837768.125170:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837768.125292:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036983040 00000100:00100000:3.0:1788837768.125297:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036983040 00000100:00100000:3.0:1788837768.125328:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788837768.125401:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036983040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788837768.125481:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837768.125516:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036983040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837768.125523:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1788837768.125541:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837768.125579:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad1162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732036983296:0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.125591:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875732036983808:0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.125600:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732036984320:0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.125612:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad1160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036983424:0@lo:400:kworker.0 00010000:00080000:3.0:1788837768.125624:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ae7f59f80 x1875732036983936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837768.125634:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7f59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875732036983936:0@lo:400:kworker.0 00010000:00080000:3.0:1788837768.125644:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3d40000 x1875732036984448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837768.125653:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732036984448:0@lo:400:kworker.0 00000100:00100000:1.0:1788837768.125812:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad1161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036983168:0@lo:400:kworker.0 00000100:00100000:1.0:1788837768.125848:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837768.125875:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad1162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036983680:0@lo:400:kworker.0 00000100:00100000:1.0:1788837768.125899:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837768.125918:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036984192:0@lo:400:kworker.0 00000100:00100000:1.0:1788837768.125940:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837768.125959:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788837768.125965:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad1160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036983552:0@lo:400:kworker.0 00000100:00100000:1.0:1788837768.125998:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837768.126016:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ae7f5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036984064:0@lo:400:kworker.0 00000100:00100000:1.0:1788837768.126035:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837768.126058:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036983680 00000100:00100000:1.0:1788837768.126063:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036983680 00000100:00100000:1.0:1788837768.126090:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788837768.126096:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036983680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837768.126132:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036983680:12345-0@lo:400:kworker.0 Request processed in 35us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837768.126139:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788837768.126157:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036984192 00000100:00100000:1.0:1788837768.126161:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036984192 00000100:00100000:1.0:1788837768.126201:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036984064 00000100:00100000:1.0:1788837768.126220:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036984064 00000100:00100000:1.0:1788837768.126242:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788837768.126248:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036984192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837768.126278:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036984192:12345-0@lo:400:kworker.0 Request processed in 30us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837768.126284:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788837768.126295:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788837768.126300:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036984064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837768.126323:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036984064:12345-0@lo:400:kworker.0 Request processed in 24us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837768.126330:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1788837768.126364:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837768.126389:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036983040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837768.126585:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ae7f5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036984064:0@lo:400:kworker.0 00000100:00100000:1.0:1788837768.126595:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad1162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036983680:0@lo:400:kworker.0 00000100:00100000:1.0:1788837768.126603:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036984192:0@lo:400:kworker.0 00000100:00100000:1.0:1788837768.126626:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036983552 00000100:00100000:1.0:1788837768.126629:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036983552 00000100:00100000:1.0:1788837768.126655:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788837768.126662:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036983552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837768.126695:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036983552:12345-0@lo:400:kworker.0 Request processed in 34us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837768.126702:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788837768.126727:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad1160700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036983552:0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.126881:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036983168 00000100:00100000:3.0:1788837768.126892:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036983168 00000100:00100000:3.0:1788837768.126946:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788837768.126953:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036983168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837768.126999:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036983168:12345-0@lo:400:kworker.0 Request processed in 47us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837768.127005:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788837768.127474:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036984576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837768.127508:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837768.127638:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad1161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036983168:0@lo:400:kworker.0 00000100:00100000:2.0:1788837768.130947:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036984576 00000100:00100000:2.0:1788837768.130964:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036984576 00000100:00100000:2.0:1788837768.131038:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788837768.131049:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036984576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788837768.131084:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788837768.131172:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036984576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (3663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837768.131529:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788837768.131588:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036984576:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788837768.192672:0:14516:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:22:47 (1788837767) 00010000:00010000:2.0:1788837768.889506:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837769.145556:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036984704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837769.145643:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837769.145696:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036984704 00000100:00100000:3.0:1788837769.145706:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036984704 00000100:00100000:3.0:1788837769.145764:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788837769.145792:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036984704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837769.145831:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788837769.147623:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c2511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036984704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837769.147692:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036984704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1917us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837769.147703:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788837769.203680:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837769.203728:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837769.203871:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012798592 00000100:00100000:1.0:1788837769.203881:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012798592 00000100:00100000:1.0:1788837769.203946:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 383 00000100:00100000:1.0:1788837769.203983:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac81a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2396:x1875732012798592:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837769.204118:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012798848 00000100:00100000:3.0:1788837769.204123:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012798848 00000100:00100000:3.0:1788837769.204167:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 295 00000100:00100000:3.0:1788837769.204174:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012798848:12345-192.168.201.3@tcp:400:kworker.0 00000100:00080000:0.0:1788837769.204265:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837769.204486:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac81a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2396:x1875732012798592:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 531us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837769.204494:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 383 00000100:00100000:3.0:1788837769.205712:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012798848:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 1529us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837769.205722:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 295 00000100:00100000:0.0:1788837769.211922:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837769.211998:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837769.212087:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012799360 00000100:00100000:1.0:1788837769.212097:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012799360 00000100:00100000:1.0:1788837769.212181:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 296 00000100:00100000:1.0:1788837769.212192:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012799360:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837769.212274:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012799360:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 83us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837769.212281:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 296 00000100:00080000:0.0:1788837769.212627:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837769.212685:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012799104 00000100:00100000:2.0:1788837769.212690:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012799104 00000100:00100000:2.0:1788837769.212808:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 125 00000100:00100000:2.0:1788837769.212816:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c2511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012799104:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837769.212845:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c2511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012799104:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 31us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837769.212851:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 125 00000100:00080000:0.0:1788837769.216234:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837769.223359:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837769.223395:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837769.223422:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837769.223499:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012798976 00000100:00100000:1.0:1788837769.223509:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012798976 00000100:00100000:1.0:1788837769.223591:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 126 00000100:00100000:1.0:1788837769.223601:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012798976:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837769.223682:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012798976:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 83us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837769.223690:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 126 00000100:00100000:3.0:1788837769.223809:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012798720 00000100:00100000:3.0:1788837769.223814:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012798720 00000100:00100000:3.0:1788837769.223846:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012799232 00000100:00100000:3.0:1788837769.223849:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012799232 00000100:00100000:3.0:1788837769.223878:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 297 00000100:00100000:3.0:1788837769.223884:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+13:2395:x1875732012798720:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837769.223915:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+13:2395:x1875732012798720:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 31us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837769.223921:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 297 00000100:00100000:3.0:1788837769.223931:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 298 00000100:00100000:3.0:1788837769.223936:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:2395:x1875732012799232:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837769.223966:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:2395:x1875732012799232:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837769.223972:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 298 00000100:00080000:2.0:1788837769.224027:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837769.224036:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837769.917880:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837769.927518:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837769.927656:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012799616 00000100:00100000:3.0:1788837769.927666:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012799616 00000100:00100000:3.0:1788837769.927743:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 150 00000100:00100000:3.0:1788837769.927753:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+13:12132:x1875732012799616:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837769.927801:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837769.927823:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef9ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec0b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.927896:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef9b3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.927909:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.927920:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.927989:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef9ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928013:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef9ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928020:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef9ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928117:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef9c1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928126:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928133:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837769.928141:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788837769.928248:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928256:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef9b3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928263:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928268:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837769.928273:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928280:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef9b3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928641:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff889aded2ca00) 00010000:00010000:3.0:1788837769.928646:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837769.928652:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef9b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928659:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aef9b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928674:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef9ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928680:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef9ba lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928685:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef9ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928690:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837769.928693:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef9ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928699:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef9ba lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928708:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8899c3351900) 00010000:00010000:3.0:1788837769.928710:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837769.928713:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef9ba lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.928718:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aef9ba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.929053:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aef9ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec0b expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.929068:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec0b expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.929075:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aded2c400) 00010000:00010000:3.0:1788837769.929077:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837769.929079:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17800, rc 0) 00000100:00100000:3.0:1788837769.929158:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+15:12132:x1875732012799616:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 1406us (1649us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788837769.929166:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 150 00000100:00100000:0.0:1788837769.947186:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837769.947242:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837769.947435:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012799872 00000100:00100000:3.0:1788837769.947447:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012799872 00000100:00100000:3.0:1788837769.947514:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:3.0:1788837769.947524:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8562450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+15:2393:x1875732012799872:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837769.947539:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837769.947565:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aef9c1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec0b expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837769.947583:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aded2c400) 00010000:00010000:3.0:1788837769.947588:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837769.947644:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8562450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+14:2393:x1875732012799872:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 121us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837769.947652:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:1.0:1788837769.948090:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012799744 00000100:00100000:1.0:1788837769.948095:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012799744 00000100:00100000:1.0:1788837769.948129:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 151 00000100:00100000:1.0:1788837769.948136:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+14:12132:x1875732012799744:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788837769.948225:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+14:12132:x1875732012799744:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 Request processed in 89us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837769.948231:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 151 00000100:00100000:0.0:1788837769.969631:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837769.971443:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012800000 00000100:00100000:3.0:1788837769.971459:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012800000 00000100:00100000:3.0:1788837769.971535:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 152 00000100:00100000:3.0:1788837769.971547:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:12132:x1875732012800000:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788837769.971670:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:12132:x1875732012800000:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 Request processed in 125us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837769.971678:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 152 00000040:00080000:0.0:1788837770.297414:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837770.297424:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837770.299283:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788837770.299312:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788837770.809871:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788837770.944878:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837771.690037:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837771.690114:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012800128 00000100:00100000:0.0:1788837771.690124:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012800128 00000100:00100000:0.0:1788837771.690197:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 153 00000100:00100000:0.0:1788837771.690209:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7f59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+14:12174:x1875732012800128:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837771.690230:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837771.690252:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aef9cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec12 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690304:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aef9d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690315:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aef9d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690325:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aef9d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690333:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aef9dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690338:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aef9dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690342:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aef9dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690382:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aef9d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690389:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aef9d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690404:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aef9d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690408:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9ac00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837771.690412:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aef9d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690417:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aef9d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690425:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ad8ad9400) 00010000:00010000:0.0:1788837771.690427:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837771.690430:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aef9d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690434:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aef9d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690443:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aef9dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690446:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aef9dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690450:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aef9dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690453:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837771.690454:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aef9dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690464:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aef9dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690468:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff889af8da5c00) 00010000:00010000:0.0:1788837771.690470:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837771.690471:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aef9dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690474:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aef9dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690495:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aef9cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec12 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690501:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ad8ad9400) 00010000:00010000:0.0:1788837771.690502:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837771.690504:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aef9cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec12 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.690509:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9a200, rc 0) 00000100:00100000:0.0:1788837771.690556:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7f59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+14:12174:x1875732012800128:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 350us (527us total) trans 0 rc 301/301 00000100:00100000:0.0:1788837771.690564:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 153 00000100:00080000:3.0:1788837771.693365:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837771.709715:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837771.709872:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012800384 00000100:00100000:1.0:1788837771.709882:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012800384 00000100:00100000:1.0:1788837771.709948:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 154 00000100:00100000:1.0:1788837771.709959:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+14:12174:x1875732012800384:12345-192.168.201.3@tcp:36:lfs.0 00010000:00010000:1.0:1788837771.710015:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837771.710044:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aef323 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea36 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.710719:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ad8ad9400) 00010000:00010000:1.0:1788837771.710724:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837771.710927:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.710942:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef9a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec04 expref: 5 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.710961:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.711009:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec04 expref: 5 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.711024:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef9a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec04 expref: 5 pid: 6525 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837771.711038:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c24e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036984832:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788837771.712106:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5e356c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.713322:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036984960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837771.713377:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837771.713424:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036984960 00000100:00100000:1.0:1788837771.713430:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036984960 00000100:00100000:1.0:1788837771.713484:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788837771.713494:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036984960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837771.713525:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788837771.713574:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036984960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.713581:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788837771.713625:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036984960:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788837771.713645:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837771.715153:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036985088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837771.715211:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837771.715261:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036985088 00000100:00100000:0.0:1788837771.715276:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036985088 00000100:00100000:0.0:1788837771.715323:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788837771.715331:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036985088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837771.715348:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788837771.715385:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036985088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837771.715392:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1788837771.715413:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837771.715446:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036985088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837771.716943:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c24e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036984832:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788837771.716967:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837771.727102:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837771.727312:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012800512 00000100:00100000:0.0:1788837771.727324:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012800512 00010000:00010000:0.0:1788837771.727380:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef9a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec04 expref: 6 pid: 6525 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837771.727417:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 79 00000100:00100000:0.0:1788837771.727427:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:2396:x1875732012800512:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837771.727442:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837771.727449:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef9a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec04 expref: 6 pid: 6525 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.727462:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef9a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec04 expref: 6 pid: 6525 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.727484:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aef9a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec04 expref: 6 pid: 6525 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.727499:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ad8ad9400) 00010000:00010000:0.0:1788837771.727513:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.727521:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.727528:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.727551:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837771.727599:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012800512:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 173us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837771.727607:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 79 00000100:00080000:1.0:1788837771.727695:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788837771.727809:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.727818:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.727837:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef9eb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.727846:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef9eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.727853:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef9eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.728424:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef9f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.728432:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef9f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.728438:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef9f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837771.728448:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020929250 reply state 00000000558420a6 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef9f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.728454:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef9f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.728466:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:1.0:1788837771.728468:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788837771.728470:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788837771.728475:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788837771.728481:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.728485:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.728490:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.728493:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837771.728496:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.728501:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.728506:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889ad8ad9400) 00010000:00010000:1.0:1788837771.728508:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837771.728510:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.728513:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aef9e4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837771.728524:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020929250 reply state 00000000558420a6 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef9eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.728535:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef9eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.728539:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff889b01a1f700) 00010000:00010000:1.0:1788837771.728540:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788837771.728541:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788837771.728593:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+15:12174:x1875732012800384:12345-192.168.201.3@tcp:36:lfs.0 Request processed in 18636us (18888us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1788837771.728598:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 154 00000100:00100000:1.0:1788837771.833659:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837771.833752:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012800640 00000100:00100000:0.0:1788837771.833762:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012800640 00000100:00100000:0.0:1788837771.833995:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 155 00000100:00100000:0.0:1788837771.834006:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+15:12182:x1875732012800640:12345-192.168.201.3@tcp:101:lctl.0 00010000:00010000:0.0:1788837771.834029:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837771.834051:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aef9f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec19 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.834115:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aefa00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.834129:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aefa00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.834140:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aefa00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837771.834188:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788837771.834218:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788837771.834244:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aefa00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.834269:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aef9f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec19 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.834288:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aefa00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec19 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837771.834297:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889af8da5c00) 00010000:00010000:0.0:1788837771.834300:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837771.834304:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9ac00, rc 0) 00000100:00100000:0.0:1788837771.834418:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+16:12182:x1875732012800640:12345-192.168.201.3@tcp:101:lctl.0 Request processed in 413us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837771.834426:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 155 00000100:00100000:0.0:1788837771.890382:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837771.890562:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012800768 00000100:00100000:3.0:1788837771.890573:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012800768 00000100:00100000:3.0:1788837771.890640:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 156 00000100:00100000:3.0:1788837771.890650:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+16:12188:x1875732012800768:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788837771.890668:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837771.890688:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefa07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec20 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.890762:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.890823:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.890835:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.890847:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.890853:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.890873:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.890959:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aefa1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.890968:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aefa1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.890975:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aefa1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837771.891008:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788837771.891012:0:9317:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837771.891031:0:9317:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aefa1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891042:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891049:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891056:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891062:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837771.891066:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891073:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891090:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889af8da5c00) 00010000:00010000:3.0:1788837771.891093:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837771.891098:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891104:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891130:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891137:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891142:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891147:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837771.891150:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891155:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891163:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff889b01a1f700) 00010000:00010000:3.0:1788837771.891166:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837771.891169:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891174:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891222:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefa07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec20 expref: 18 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891235:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aefa1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec20 expref: 17 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.891242:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:3.0:1788837771.891243:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788837771.891246:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17e00, rc 0) 00000100:00100000:3.0:1788837771.891304:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+17:12188:x1875732012800768:12345-192.168.201.3@tcp:101:bash.0 Request processed in 656us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837771.891311:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 156 00000100:00100000:1.0:1788837771.897735:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837771.897814:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012801024 00000100:00100000:3.0:1788837771.897824:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012801024 00000100:00100000:3.0:1788837771.897882:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 157 00000100:00100000:3.0:1788837771.897891:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+17:12188:x1875732012801024:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788837771.897920:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837771.897943:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefa23 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec27 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898050:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa2a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898064:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898075:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898140:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898148:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898155:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837771.898481:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788837771.898614:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefa38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898623:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefa38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898630:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefa38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898661:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898669:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa2a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898675:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898681:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837771.898685:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898705:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa2a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898718:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:3.0:1788837771.898721:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837771.898726:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa2a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898732:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa2a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837771.898745:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b50b6c8 reply state 0000000084550233 transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898755:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.898760:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889ac4fa7a00) 00010000:00010000:3.0:1788837771.898762:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788837771.898765:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788837771.899018:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefa23 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec27 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.899035:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefa38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec27 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.899041:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7200) 00010000:00010000:3.0:1788837771.899043:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837771.899045:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17c00, rc 0) 00000100:00100000:3.0:1788837771.899159:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+20:12188:x1875732012801024:12345-192.168.201.3@tcp:101:bash.0 Request processed in 1268us (1442us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788837771.899173:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 157 00000100:00100000:0.0:1788837771.903735:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837771.903867:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012801152 00000100:00100000:1.0:1788837771.903876:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012801152 00000100:00100000:1.0:1788837771.903950:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:1.0:1788837771.903959:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012801152:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788837771.903975:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837771.903995:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefa46 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec2e expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837771.904018:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837771.904035:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=388s v=(0 0) 00010000:00010000:1.0:1788837771.904040:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837771.904048:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefa46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec2e expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.904065:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefa46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec2e expref: 6 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837771.904092:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9000, rc 0) 00000100:00100000:1.0:1788837771.904161:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+6:2396:x1875732012801152:12345-192.168.201.3@tcp:101:bash.0 Request processed in 202us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837771.904167:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00080000:0.0:1788837771.904423:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837771.908150:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837771.908568:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012801280 00000100:00100000:2.0:1788837771.908578:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012801280 00000100:00100000:2.0:1788837771.908636:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:2.0:1788837771.908646:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:12188:x1875732012801280:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788837771.908663:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837771.908683:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec35 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.908714:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefa46 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec2e expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.908734:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837771.908738:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837771.908744:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.908815:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefa46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec2e expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.908829:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefa46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec2e expref: 7 pid: 8440 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837771.908844:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1875732036985216:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837771.908942:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2629a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837771.913369:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1875732036985216:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837771.913424:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837771.913445:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1325a00, rc 0) 00000100:00100000:2.0:1788837771.913513:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:12188:x1875732012801280:12345-192.168.201.3@tcp:101:bash.0 Request processed in 4868us (5372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837771.913523:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:0.0:1788837771.915425:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837771.915507:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012801408 00000100:00100000:3.0:1788837771.915516:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012801408 00010000:00010000:3.0:1788837771.915555:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefa46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec2e expref: 7 pid: 8440 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837771.915596:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00100000:3.0:1788837771.915605:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012801408:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837771.915621:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837771.915643:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefa46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec2e expref: 7 pid: 8440 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.915658:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefa46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec2e expref: 7 pid: 8440 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.915680:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefa46 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec2e expref: 7 pid: 8440 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.915698:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837771.915702:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837771.915711:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.915721:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837771.915836:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837771.915851:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6509:1875732036985344:192.168.201.3@tcp:105: 00000100:00100000:3.0:1788837771.915939:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837771.919543:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837771.919640:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6509:1875732036985344:192.168.201.3@tcp:105: 00010000:00010000:3.0:1788837771.919665:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837771.919722:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012801408:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 4118us (4305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837771.919741:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00100000:0.0:1788837771.919979:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012801664 00000100:00100000:0.0:1788837771.919987:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012801664 00000100:00100000:0.0:1788837771.920037:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:0.0:1788837771.920045:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+20:12188:x1875732012801664:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:0.0:1788837771.920318:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+21:12188:x1875732012801664:12345-192.168.201.3@tcp:35:bash.0 Request processed in 274us (785us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788837771.920326:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 36 00010000:00010000:2.0:1788837771.960993:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837772.003512:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837772.003598:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012801920 00000100:00100000:3.0:1788837772.003608:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012801920 00000100:00100000:3.0:1788837772.003669:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 158 00000100:00100000:3.0:1788837772.003679:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+21:12197:x1875732012801920:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788837772.003703:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837772.003733:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefa54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec3c expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837772.003853:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788837772.003959:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefa54 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec3c expref: 23 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.003974:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889af8da5c00) 00010000:00010000:3.0:1788837772.003977:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837772.003995:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefa54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec3c expref: 23 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.004009:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17800, rc 0) 00000100:00100000:3.0:1788837772.004076:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+22:12197:x1875732012801920:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 398us (574us total) trans 4294967422 rc 301/301 00000100:00100000:3.0:1788837772.004083:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 158 00000100:00100000:1.0:1788837772.008358:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837772.008454:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012802176 00000100:00100000:0.0:1788837772.008476:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012802176 00000100:00100000:0.0:1788837772.008538:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 37 00000100:00100000:0.0:1788837772.008548:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+22:12197:x1875732012802176:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:0.0:1788837772.008822:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+23:12197:x1875732012802176:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 275us (485us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788837772.008831:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 37 00000100:00100000:0.0:1788837772.080334:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837772.080525:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012802304 00000100:00100000:3.0:1788837772.080545:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012802304 00000100:00100000:3.0:1788837772.080610:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 159 00000100:00100000:3.0:1788837772.080620:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+23:12204:x1875732012802304:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788837772.080643:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837772.080664:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefa62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec43 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.080741:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.080756:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.080769:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837772.080849:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788837772.080853:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837772.080872:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.080897:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefa62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec43 expref: 25 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.080958:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec43 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.080967:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:3.0:1788837772.080970:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837772.080974:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16a00, rc 0) 00000100:00100000:3.0:1788837772.081022:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+24:12204:x1875732012802304:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 404us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837772.081029:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 159 00000100:00100000:1.0:1788837772.087071:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837772.087134:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012802560 00000100:00100000:3.0:1788837772.087144:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012802560 00000100:00100000:3.0:1788837772.087216:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 160 00000100:00100000:3.0:1788837772.087226:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+24:12204:x1875732012802560:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788837772.087251:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837772.087274:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefa70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec4a expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.087407:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefa77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.087422:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefa77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.087442:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefa77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837772.087452:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788837772.087565:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefa70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec4a expref: 27 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.087579:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefa77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec4a expref: 26 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.087585:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7200) 00010000:00010000:3.0:1788837772.087587:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837772.087590:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16600, rc 0) 00000100:00100000:3.0:1788837772.087896:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+26:12204:x1875732012802560:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 672us (835us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1788837772.087901:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 160 00000100:00100000:1.0:1788837772.090881:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837772.090936:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837772.091207:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012802944 00000100:00100000:3.0:1788837772.091217:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012802944 00000100:00100000:3.0:1788837772.091275:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 161 00000100:00100000:3.0:1788837772.091287:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+26:12204:x1875732012802944:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788837772.091316:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837772.091341:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aefa85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec51 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.091680:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefa8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.091697:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefa8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.091710:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefa8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837772.091741:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000100:00100000:0.0:1788837772.091800:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012802688 00000100:00100000:0.0:1788837772.091806:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012802688 00000100:00100000:0.0:1788837772.091845:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:0.0:1788837772.091851:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+29:2396:x1875732012802688:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837772.091862:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837772.091872:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aefa85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec51 expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.092846:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefa8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec51 expref: 29 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.092853:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefa77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec4a expref: 29 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.092857:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7200) 00010000:00010000:3.0:1788837772.092860:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788837772.092863:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0030a00, rc 0) 00010000:00010000:0.0:1788837772.092865:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7200) 00010000:00010000:0.0:1788837772.092867:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837772.092977:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+28:12204:x1875732012802944:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 1691us (2039us total) trans 4294967425 rc 0/0 00000100:00100000:0.0:1788837772.092977:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+28:2396:x1875732012802688:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 1124us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837772.092986:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 161 00000100:00100000:0.0:1788837772.092986:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:0.0:1788837772.096598:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837772.096688:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012803072 00000100:00100000:2.0:1788837772.096699:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012803072 00000100:00100000:2.0:1788837772.096759:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:2.0:1788837772.096769:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012803072:12345-192.168.201.3@tcp:1:lfs.0 00010000:00010000:2.0:1788837772.096837:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088676c06/0x57f6d4e926aefa9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.096855:0:14078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.096861:0:14078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837772.096864:0:14078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837772.096867:0:14078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088676c06/0x57f6d4e926aefa9a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.096894:0:14078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.096915:0:14078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 6 pid: 8439 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837772.096939:0:14078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14078:1875732036985472:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837772.097006:0:14078:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2629a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837772.099712:0:14078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14078:1875732036985472:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837772.099874:0:14078:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088676c06/0x57f6d4e926aefa9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837772.100027:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837772.100074:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012803200 00000100:00100000:2.0:1788837772.100081:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012803200 00002000:00100000:2.0:1788837772.100128:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff889affc4f800 x1875732012803200/t0(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:428/0 lens 504/0 e 0 to 0 dl 1788837783 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788837772.100138:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889affc4f800 with x1875732012803200 ext(0->12) 00010000:00010000:2.0:1788837772.100145:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 7 pid: 8439 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.100159:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 7 pid: 8439 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788837772.100167:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff889affc4f800 00000100:00100000:2.0:1788837772.100294:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:2.0:1788837772.100306:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012803200:12345-192.168.201.3@tcp:4:lfs.0 00000100:00100000:2.0:1788837772.101135:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3a879e24-3b2f-4404-84c2-9101689d9315+9:2395:x1875732012803200:12345-192.168.201.3@tcp:4:lfs.0 Request processed in 827us (1102us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788837772.101145:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00002000:00100000:2.0:1788837772.101161:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff889affc4f800 x1875732012803200/t4294967306(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:428/0 lens 504/448 e 0 to 0 dl 1788837783 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788837772.101167:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889affc4f800 with x1875732012803200 ext(0->12) 00010000:00010000:2.0:1788837772.101173:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 9 pid: 8439 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.101192:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 9 pid: 8439 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788837772.101197:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff889affc4f800 00000100:00100000:1.0:1788837772.104091:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837772.104876:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012803328 00000100:00100000:0.0:1788837772.104891:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012803328 00010000:00010000:0.0:1788837772.104949:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 9 pid: 8439 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837772.105061:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 81 00000100:00100000:0.0:1788837772.105071:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+9:2395:x1875732012803328:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837772.105086:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788837772.105103:0:9528:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788837772.105106:0:9528:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788837772 00002000:00010000:0.0:1788837772.105120:0:9528:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788837772 00002000:00010000:0.0:1788837772.105122:0:9528:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788837772 00002000:00010000:0.0:1788837772.105124:0:9528:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788837772.105132:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 9 pid: 8439 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.105146:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 9 pid: 8439 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.105169:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c34e0133/0x57f6d4e926aefa4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec35 expref: 9 pid: 8439 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.105186:0:9528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837772.105190:0:9528:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837772.105196:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088676c06/0x57f6d4e926aefa9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.105364:0:9528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088676c06/0x57f6d4e926aefa9a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.105423:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837772.105493:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+8:2395:x1875732012803328:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 423us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837772.105501:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 81 00010000:00010000:2.0:1788837772.105937:0:14078:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088676c06/0x57f6d4e926aefa9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.105947:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088676c06/0x57f6d4e926aefa9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.105966:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088676c06/0x57f6d4e926aefa9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.105974:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088676c06/0x57f6d4e926aefa9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.105983:0:14078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088676c06/0x57f6d4e926aefa9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.105990:0:14078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324e00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837772.106004:0:14078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088676c06/0x57f6d4e926aefa9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.106015:0:14078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088676c06/0x57f6d4e926aefa9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.106028:0:14078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088676c06/0x57f6d4e926aefa9a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.106036:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088676c06/0x57f6d4e926aefa9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837772.106101:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012803072:12345-192.168.201.3@tcp:1:lfs.0 Request processed in 9333us (9512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837772.106117:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:1.0:1788837772.110646:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837772.110731:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012803584 00000100:00100000:2.0:1788837772.110741:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012803584 00000100:00100000:2.0:1788837772.110819:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:2.0:1788837772.110830:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8e7a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+27:12204:x1875732012803584:12345-192.168.201.3@tcp:35:lfs.0 00000004:00010000:2.0:1788837772.110891:0:6528:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefa8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec51 expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837772.111087:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788837772.111189:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1788837772.111864:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:2.0:1788837772.111902:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.111946:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefa38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec27 expref: 31 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.111957:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.111991:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefa38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec27 expref: 31 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.112006:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefa38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec27 expref: 31 pid: 6525 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837772.112021:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d64000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1875732036985600:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837772.112100:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2629a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837772.118344:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837772.118416:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012803712 00000100:00100000:0.0:1788837772.118437:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012803712 00010000:00010000:0.0:1788837772.118475:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefa38 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec27 expref: 32 pid: 6525 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837772.118518:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 82 00000100:00100000:0.0:1788837772.118537:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+32:2396:x1875732012803712:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837772.118551:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837772.118557:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefa38 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec27 expref: 32 pid: 6525 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.118570:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefa38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec27 expref: 32 pid: 6525 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.118591:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7200) 00010000:00010000:0.0:1788837772.118596:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.118605:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.118614:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.118646:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837772.118700:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+32:2396:x1875732012803712:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 164us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837772.118709:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 82 00010000:00010000:2.0:1788837772.119689:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefa38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec27 expref: 31 pid: 6525 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837772.119708:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d64000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1875732036985600:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837772.119727:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.119735:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.119741:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837772.119884:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:2.0:1788837772.120019:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788837772.120106:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d64000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875732036985728:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788837772.120968:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837772.121011:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2629600 going to sleep for 11 seconds 00000100:00100000:3.0:1788837772.121240:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036985728 00000100:00100000:3.0:1788837772.121259:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036985728 00000100:00100000:3.0:1788837772.121324:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788837772.121334:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1875732036985728:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788837772.121455:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6528:x1875732036985728:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 123us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837772.121463:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788837772.121695:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d64000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875732036985728:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788837772.121862:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:1.0:1788837772.121937:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c24e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875732036985856:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788837772.121970:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837772.121995:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4bcc0 going to sleep for 11 seconds 00000100:00080000:0.0:1788837772.122091:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837772.122269:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036985856 00000100:00100000:3.0:1788837772.122274:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036985856 00000100:00100000:3.0:1788837772.122310:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788837772.122317:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1875732036985856:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788837772.122446:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6528:x1875732036985856:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 129us (475us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788837772.122469:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788837772.122891:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c24e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875732036985856:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788837772.122947:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1788837772.122984:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.122995:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.123009:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.123015:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837772.123020:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.123028:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.123042:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7200) 00010000:00010000:1.0:1788837772.123046:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788837772.123051:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.123058:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefaa1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788837772.123158:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788837772.123215:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788837772.123229:0:6528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 388994451539ns, next at 389994447344ns, rc = 0 00000001:00080000:1.0:1788837772.123234:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:1.0:1788837772.123267:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7200) 00010000:00010000:1.0:1788837772.123270:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788837772.123276:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefa8c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec51 expref: 35 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837772.123397:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8e7a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+34:12204:x1875732012803584:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 12569us (12972us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788837772.123415:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 38 00000020:00080000:1.0:1788837772.123420:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788837772.129882:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837772.130089:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012803840 00000100:00100000:3.0:1788837772.130100:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012803840 00000100:00100000:3.0:1788837772.130167:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 162 00000100:00100000:3.0:1788837772.130177:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+34:12204:x1875732012803840:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788837772.130208:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837772.130232:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aefaa8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec58 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.130296:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aefaa8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec58 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.130313:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aefaa8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec58 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.130330:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:3.0:1788837772.130344:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837772.130348:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0031800, rc 0) 00000100:00100000:3.0:1788837772.130414:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+35:12204:x1875732012803840:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 238us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837772.130421:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 162 00000100:00100000:0.0:1788837772.135102:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837772.135193:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012804096 00000100:00100000:3.0:1788837772.135203:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012804096 00000100:00100000:3.0:1788837772.135266:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:3.0:1788837772.135277:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+35:12204:x1875732012804096:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:3.0:1788837772.135764:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+36:12204:x1875732012804096:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 488us (672us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788837772.135810:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:1.0:1788837772.234448:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837772.234646:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012804352 00000100:00100000:0.0:1788837772.234658:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012804352 00000100:00100000:0.0:1788837772.234723:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 163 00000100:00100000:0.0:1788837772.234734:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+36:12214:x1875732012804352:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837772.234757:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837772.234810:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefaaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec5f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837772.234921:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788837772.235022:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefaaf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec5f expref: 38 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.235038:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889af8da5c00) 00010000:00010000:0.0:1788837772.235040:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837772.235045:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefaaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec5f expref: 38 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.235060:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9ae00, rc 0) 00000100:00100000:0.0:1788837772.235127:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+37:12214:x1875732012804352:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 395us (700us total) trans 4294967436 rc 301/301 00000100:00100000:0.0:1788837772.235152:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 163 00000100:00100000:1.0:1788837772.240821:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837772.240921:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012804480 00000100:00100000:0.0:1788837772.240932:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012804480 00000100:00100000:0.0:1788837772.240987:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 164 00000100:00100000:0.0:1788837772.240998:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+37:12214:x1875732012804480:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:0.0:1788837772.241078:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefabd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241097:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefabd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241119:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefabd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241131:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefac4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241140:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefac4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241147:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefac4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241232:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefacb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241241:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefacb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241248:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefacb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837772.241308:0:9317:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefacb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241321:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefabd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241328:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefabd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241334:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefabd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241340:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9ae00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837772.241344:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefabd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241351:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefabd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241363:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:0.0:1788837772.241366:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837772.241370:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefabd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241376:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefabd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241388:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefac4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241394:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefac4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241406:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefac4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241411:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837772.241414:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefac4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241420:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefac4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241427:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889ac4fa7a00) 00010000:00010000:0.0:1788837772.241430:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837772.241433:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefac4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241438:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefac4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241447:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefacb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241453:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefacb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241458:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefacb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241463:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837772.241465:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefacb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241479:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefacb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241487:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:0.0:1788837772.241489:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837772.241492:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefacb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.241498:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefacb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837772.241584:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+37:12214:x1875732012804480:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 588us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837772.241592:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 164 00000100:00100000:1.0:1788837772.244531:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837772.244656:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012804736 00000100:00100000:2.0:1788837772.244665:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012804736 00000100:00100000:2.0:1788837772.244719:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:2.0:1788837772.244729:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+37:12214:x1875732012804736:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788837772.244970:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+38:12214:x1875732012804736:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 242us (457us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788837772.244978:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:1.0:1788837772.291244:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837772.291353:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012804992 00000100:00100000:0.0:1788837772.291363:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012804992 00000100:00100000:0.0:1788837772.291431:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 165 00000100:00100000:0.0:1788837772.291442:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+38:12217:x1875732012804992:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837772.291465:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837772.291486:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefad2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec66 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291572:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefad9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291588:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefad9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291599:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefad9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291628:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefae0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291636:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291642:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291761:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefae7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291770:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291827:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefae7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837772.291837:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788837772.291922:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefad9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291931:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefad9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291937:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefad9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291943:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837772.291946:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefad9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291963:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefad9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291976:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:0.0:1788837772.291978:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837772.291984:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefad9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.291991:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefad9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.292005:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.292010:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefae0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.292016:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.292020:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9ae00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837772.292023:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.292029:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefae0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.292035:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889ac4fa7a00) 00010000:00010000:0.0:1788837772.292037:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837772.292040:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefae0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.292056:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefae0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.292094:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefad2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec66 expref: 41 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.292109:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefae7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec66 expref: 40 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.292116:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:0.0:1788837772.292118:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837772.292121:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9a400, rc 0) 00000100:00100000:0.0:1788837772.292176:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+40:12217:x1875732012804992:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 736us (942us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788837772.292184:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 165 00000100:00100000:1.0:1788837772.298926:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837772.299089:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012805120 00000100:00100000:0.0:1788837772.299100:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012805120 00000100:00100000:0.0:1788837772.299170:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 166 00000100:00100000:0.0:1788837772.299180:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+40:12217:x1875732012805120:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:0.0:1788837772.299249:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefaf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.299266:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.299277:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.299320:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.299328:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefaf5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.299335:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefaf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.299341:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837772.299345:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefaf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.299352:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefaf5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.299364:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:0.0:1788837772.299367:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837772.299372:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefaf5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.299377:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefaf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837772.299462:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+40:12217:x1875732012805120:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 283us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837772.299469:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 166 00000100:00100000:1.0:1788837772.302818:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837772.302972:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012805376 00000100:00100000:2.0:1788837772.302983:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012805376 00000100:00100000:2.0:1788837772.303040:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:2.0:1788837772.303050:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+40:12217:x1875732012805376:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788837772.303312:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+41:12217:x1875732012805376:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 262us (547us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788837772.303320:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 41 00000040:00080000:3.0:1788837772.345278:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837772.345288:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837772.345396:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788837772.345402:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788837772.596628:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837772.596739:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012805632 00000100:00100000:0.0:1788837772.596749:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012805632 00000100:00100000:0.0:1788837772.597624:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 167 00000100:00100000:0.0:1788837772.597650:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+41:12248:x1875732012805632:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:0.0:1788837772.597674:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837772.597696:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefafc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec6d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.598059:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefb03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.598075:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefb03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.598086:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefb03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837772.598097:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788837772.598540:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefafc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec6d expref: 44 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.598563:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefb03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec6d expref: 43 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.598572:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:0.0:1788837772.598575:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837772.598579:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9ae00, rc 0) 00000100:00100000:0.0:1788837772.598689:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+43:12248:x1875732012805632:12345-192.168.201.3@tcp:101:cat.0 Request processed in 1042us (2070us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788837772.598697:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 167 00000100:00100000:1.0:1788837772.602761:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837772.604264:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837772.604315:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012806016 00000100:00100000:3.0:1788837772.604333:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012806016 00000100:00100000:3.0:1788837772.604399:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:3.0:1788837772.604408:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+43:2394:x1875732012806016:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837772.604424:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837772.604448:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefb03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec6d expref: 43 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.604468:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:3.0:1788837772.604473:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837772.604526:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+42:2394:x1875732012806016:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 119us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837772.604534:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:2.0:1788837772.604677:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012805888 00000100:00100000:2.0:1788837772.604684:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012805888 00000100:00100000:2.0:1788837772.604733:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:2.0:1788837772.604742:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+42:12248:x1875732012805888:12345-192.168.201.3@tcp:35:cat.0 00000100:00100000:2.0:1788837772.605163:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+43:12248:x1875732012805888:12345-192.168.201.3@tcp:35:cat.0 Request processed in 422us (2410us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788837772.605171:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:1.0:1788837772.672274:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837772.672503:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012806272 00000100:00100000:0.0:1788837772.672514:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012806272 00000100:00100000:0.0:1788837772.672600:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 168 00000100:00100000:0.0:1788837772.672610:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+43:12254:x1875732012806272:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:0.0:1788837772.672635:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837772.672638:0:9317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788837772.672666:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefa69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec43 expref: 43 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.672684:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:0.0:1788837772.672689:0:9317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837772.672702:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefb11 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec74 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.672867:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.672881:0:9317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefae7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec66 expref: 43 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.672889:0:9317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.672949:0:9317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefae7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec66 expref: 43 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.672963:0:9317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefae7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec66 expref: 43 pid: 6526 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837772.672977:0:9317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036985984:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837772.673814:0:9317:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad2a76f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837772.685767:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837772.685891:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012806400 00000100:00100000:2.0:1788837772.685924:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012806400 00010000:00010000:2.0:1788837772.685967:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefae7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec66 expref: 44 pid: 6526 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837772.686024:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 83 00000100:00100000:2.0:1788837772.686033:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8563450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+44:2396:x1875732012806400:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837772.686049:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837772.686273:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefae7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec66 expref: 44 pid: 6526 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.686292:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefae7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec66 expref: 44 pid: 6526 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.686315:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:2.0:1788837772.686320:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.686338:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.686346:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.686365:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837772.686547:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8563450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+44:2396:x1875732012806400:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 514us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837772.686556:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 83 00010000:00010000:0.0:1788837772.687378:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefae7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec66 expref: 43 pid: 6526 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837772.687398:0:9317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036985984:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837772.687417:0:9317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.687426:0:9317:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.687431:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837772.687451:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788837772.687587:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefb11 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec74 expref: 44 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.687603:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec74 expref: 43 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837772.687610:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:0.0:1788837772.687613:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788837772.687616:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b000, rc 0) 00000100:00100000:0.0:1788837772.687666:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+43:12254:x1875732012806272:12345-192.168.201.3@tcp:101:dd.0 Request processed in 15058us (15404us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788837772.687674:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 168 00000100:00100000:1.0:1788837772.689653:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837772.689743:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012806528 00000100:00100000:3.0:1788837772.689754:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012806528 00000100:00100000:3.0:1788837772.689831:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 169 00000100:00100000:3.0:1788837772.689841:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+43:12254:x1875732012806528:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:3.0:1788837772.689863:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837772.689884:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aefb26 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec7b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.689951:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefb2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.689965:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefb2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.689976:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefb2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.690266:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aefb26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec7b expref: 45 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.690285:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefb2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec7b expref: 44 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.690294:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:3.0:1788837772.690297:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788837772.690301:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0030a00, rc 0) 00000100:00100000:3.0:1788837772.690444:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+44:12254:x1875732012806528:12345-192.168.201.3@tcp:101:dd.0 Request processed in 604us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837772.690451:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 169 00000100:00100000:1.0:1788837772.694687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837772.694821:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012806784 00000100:00100000:2.0:1788837772.694832:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012806784 00000100:00100000:2.0:1788837772.694909:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 170 00000100:00100000:2.0:1788837772.694920:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+44:12254:x1875732012806784:12345-192.168.201.3@tcp:36:dd.0 00010000:00010000:2.0:1788837772.695549:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefb34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.695569:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefb34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.695579:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefb34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788837772.695621:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788837772.695643:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000100ee1b1 reply state 000000009d0fb633 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefb34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.695655:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefb34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837772.695662:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:2.0:1788837772.695665:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788837772.695668:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837772.695766:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+47:12254:x1875732012806784:12345-192.168.201.3@tcp:36:dd.0 Request processed in 847us (1088us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788837772.695773:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 170 00000020:00080000:2.0:1788837772.697233:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1788837772.858666:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788837772.966823:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837772.966923:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012806912 00000100:00100000:3.0:1788837772.966933:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012806912 00000100:00100000:3.0:1788837772.966999:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 171 00000100:00100000:3.0:1788837772.967010:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+47:12268:x1875732012806912:12345-192.168.201.3@tcp:101:stat.0 00010000:00010000:3.0:1788837772.967035:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837772.967056:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aefb3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec82 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.967154:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefb42 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.967169:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefb42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.967180:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefb42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.967189:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefb49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.967203:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefb49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.967211:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefb49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.967274:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefb50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.967284:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec74 expref: 48 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.967293:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefb50 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.967500:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec74 expref: 48 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.967526:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec74 expref: 48 pid: 9317 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837772.967541:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dac380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036986112:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788837772.967633:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788837772.976372:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837772.976498:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012807168 00000100:00100000:2.0:1788837772.976508:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012807168 00000100:00100000:2.0:1788837772.976582:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:2.0:1788837772.976593:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+49:6164:x1875732012807168:12345-192.168.201.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788837772.976645:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dac380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036986112:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837772.976671:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefb50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837772.977615:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+50:6164:x1875732012807168:12345-192.168.201.3@tcp:35:ldlm_bl.0 Request processed in 1019us (1246us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1788837772.977625:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:1.0:1788837772.979624:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837772.979706:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012807296 00000100:00100000:3.0:1788837772.979717:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012807296 00010000:00010000:3.0:1788837772.979752:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec74 expref: 50 pid: 9317 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837772.979820:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 84 00000100:00100000:3.0:1788837772.979830:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+50:2396:x1875732012807296:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837772.979844:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837772.979851:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec74 expref: 50 pid: 9317 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.979864:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec74 expref: 50 pid: 9317 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.979922:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefb18 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec74 expref: 50 pid: 9317 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.979939:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:3.0:1788837772.979944:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefb50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.979954:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefb50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.979962:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefb50 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837772.979998:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837772.980065:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+49:2396:x1875732012807296:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 236us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837772.980072:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 84 00010000:00010000:1.0:1788837772.980466:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefb50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980476:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefb50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837772.980528:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788837772.980533:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837772.980557:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefb50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980592:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefb50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980601:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefb42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980608:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefb42 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980614:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefb42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980620:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837772.980624:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefb42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980631:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefb42 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980642:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:1.0:1788837772.980645:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837772.980648:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefb42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980654:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefb42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980666:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefb49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980672:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefb49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980684:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefb49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980689:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837772.980692:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefb49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980698:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefb49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980707:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889ac4fa7a00) 00010000:00010000:1.0:1788837772.980709:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837772.980712:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefb49 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980718:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefb49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980748:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aefb3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec82 expref: 49 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980764:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefb50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec82 expref: 48 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837772.980771:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:1.0:1788837772.980819:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837772.980823:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16600, rc 0) 00000100:00100000:1.0:1788837772.980856:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+48:12268:x1875732012806912:12345-192.168.201.3@tcp:101:stat.0 Request processed in 13848us (14043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837772.980871:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 171 00010000:00010000:0.0:1788837772.985012:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837773.035448:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837773.035579:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012807552 00000100:00100000:0.0:1788837773.035590:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012807552 00000100:00100000:0.0:1788837773.035671:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 172 00000100:00100000:0.0:1788837773.035682:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+48:12274:x1875732012807552:12345-192.168.201.3@tcp:36:truncate.0 00010000:00010000:0.0:1788837773.035741:0:9317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837773.035767:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefb50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec82 expref: 48 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.035947:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:0.0:1788837773.035952:0:9317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1788837773.036176:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788837773.037267:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefb57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.037288:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefb57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.037298:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefb57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837773.038973:0:9317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:0.0:1788837773.039041:0:9317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005004d774 reply state 00000000ce3cd7d1 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefb57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.040356:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefb57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.040365:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:0.0:1788837773.040368:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788837773.040373:0:9317:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837773.040527:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+50:12274:x1875732012807552:12345-192.168.201.3@tcp:36:truncate.0 Request processed in 4842us (5085us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788837773.040550:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 172 00000020:00080000:0.0:1788837773.040556:0:9317:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788837773.153652:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837773.153835:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012807680 00000100:00100000:0.0:1788837773.153844:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012807680 00000100:00100000:0.0:1788837773.153945:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 173 00000100:00100000:0.0:1788837773.153969:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+50:12288:x1875732012807680:12345-192.168.201.3@tcp:101:stat.0 00010000:00010000:0.0:1788837773.154008:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837773.154030:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefb5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec89 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154116:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb65 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154132:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154145:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154156:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154164:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154169:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154289:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefb73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154602:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154610:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837773.154674:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788837773.154690:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788837773.154725:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154739:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefb73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154758:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154763:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb65 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154823:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154831:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837773.154844:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154853:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb65 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154875:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:0.0:1788837773.154894:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837773.154914:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154920:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154935:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154941:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154962:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154968:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837773.154970:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.154992:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.155000:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889ac4fa7a00) 00010000:00010000:0.0:1788837773.155003:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837773.155006:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.155011:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.155040:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefb5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec89 expref: 52 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.155130:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefb73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec89 expref: 51 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.155156:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:0.0:1788837773.155159:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837773.155162:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9ba00, rc 0) 00000100:00100000:0.0:1788837773.155335:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+51:12288:x1875732012807680:12345-192.168.201.3@tcp:101:stat.0 Request processed in 1379us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837773.155354:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 173 00000100:00100000:0.0:1788837773.241097:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036986240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837773.241177:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837773.241392:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036986240 00000100:00100000:2.0:1788837773.241400:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036986240 00000100:00100000:2.0:1788837773.241448:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788837773.241457:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036986240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788837773.241491:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788837773.241537:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036986240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837773.241542:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788837773.241729:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036986240:0@lo:41:osp-pre-1-0.0 00000004:00080000:1.0:1788837773.242549:0:9993:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 390113770421ns, next at 391113767889ns, rc = 0 00000100:00100000:1.0:1788837773.242568:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837773.242580:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036986368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837773.242624:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837773.242669:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036986368 00000100:00100000:1.0:1788837773.242673:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036986368 00000100:00100000:1.0:1788837773.242701:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788837773.242709:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036986368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837773.242732:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788837773.242795:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036986368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837773.242802:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788837773.242841:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036986368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837773.243246:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837773.243258:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036986496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837773.243287:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837773.243443:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036986496 00000100:00100000:2.0:1788837773.243448:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036986496 00000100:00100000:2.0:1788837773.243484:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788837773.243490:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036986496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837773.243500:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788837773.243525:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036986496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837773.243528:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1788837773.243571:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837773.243590:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036986496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837773.244079:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837773.244430:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036986880:0@lo:400:kworker.0 00000100:00100000:3.0:1788837773.244472:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837773.244501:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837773.244506:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036986752:0@lo:400:kworker.0 00000100:00100000:3.0:1788837773.244533:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837773.244534:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036987008:0@lo:400:kworker.0 00000100:00100000:1.0:1788837773.244561:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837773.244578:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036986624:0@lo:400:kworker.0 00000100:00100000:3.0:1788837773.244579:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036986880 00000100:00100000:3.0:1788837773.244583:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036986880 00000100:00100000:1.0:1788837773.244602:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837773.244616:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788837773.244623:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036986880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837773.244633:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036986624 00000100:00100000:1.0:1788837773.244637:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036986624 00000100:00100000:1.0:1788837773.244662:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788837773.244663:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036986880:12345-0@lo:400:kworker.0 Request processed in 40us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837773.244668:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3650:x1875732036986624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837773.244670:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788837773.244696:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036986880:0@lo:400:kworker.0 00000100:00100000:1.0:1788837773.244708:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3650:x1875732036986624:12345-0@lo:400:kworker.0 Request processed in 40us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837773.244714:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788837773.244720:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036986752 00000100:00100000:3.0:1788837773.244723:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036986752 00000100:00100000:3.0:1788837773.244744:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036987008 00000100:00100000:1.0:1788837773.244744:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732036986624:0@lo:400:kworker.0 00000100:00100000:3.0:1788837773.244747:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036987008 00000100:00100000:3.0:1788837773.244765:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788837773.244771:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036986752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837773.244808:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788837773.244815:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036987008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837773.244825:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036986752:12345-0@lo:400:kworker.0 Request processed in 55us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837773.244832:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788837773.244845:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036987008:12345-0@lo:400:kworker.0 Request processed in 31us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837773.244851:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788837773.244855:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036986752:0@lo:400:kworker.0 00000100:00100000:1.0:1788837773.244872:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036987008:0@lo:400:kworker.0 00000100:00100000:1.0:1788837773.245682:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036987520:0@lo:400:kworker.0 00000100:00100000:1.0:1788837773.245720:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837773.245752:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788837773.245759:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036987136:0@lo:400:kworker.0 00000100:00100000:0.0:1788837773.245908:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036987520 00000100:00100000:0.0:1788837773.245914:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036987520 00000100:00100000:2.0:1788837773.245924:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036987264:0@lo:400:kworker.0 00000100:00100000:2.0:1788837773.245955:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837773.245956:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788837773.245963:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036987520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837773.245970:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036987776:0@lo:400:kworker.0 00000100:00100000:2.0:1788837773.245994:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837773.246009:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837773.246014:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036987392:0@lo:400:kworker.0 00000100:00100000:2.0:1788837773.246036:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837773.246063:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036987392 00000100:00100000:2.0:1788837773.246081:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036987392 00000100:00100000:2.0:1788837773.246107:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788837773.246113:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036987392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837773.246164:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036987392:12345-0@lo:400:kworker.0 Request processed in 51us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837773.246171:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788837773.246204:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036987392:0@lo:400:kworker.0 00000100:00080000:3.0:1788837773.246482:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837773.246502:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036987264 00000100:00100000:1.0:1788837773.246503:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837773.246505:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036987264 00000100:00100000:1.0:1788837773.246532:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036987648:0@lo:400:kworker.0 00000100:00100000:3.0:1788837773.246533:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036987776 00000100:00100000:3.0:1788837773.246535:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036987776 00000100:00100000:3.0:1788837773.246548:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036987136 00000100:00100000:3.0:1788837773.246550:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036987136 00000100:00100000:1.0:1788837773.246553:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837773.246562:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036987648 00000100:00100000:3.0:1788837773.246565:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036987648 00000100:00100000:3.0:1788837773.246579:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788837773.246584:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036987264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837773.246630:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036987520:12345-0@lo:400:kworker.0 Request processed in 666us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837773.246636:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788837773.246663:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036987520:0@lo:400:kworker.0 00000100:00100000:3.0:1788837773.246673:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732036987264:12345-0@lo:400:kworker.0 Request processed in 89us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837773.246700:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788837773.246709:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036987776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837773.246740:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732036987776:12345-0@lo:400:kworker.0 Request processed in 34us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837773.246746:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788837773.246761:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00010000:00080000:0.0:1788837773.246873:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889affc4ca80 x1875732036987264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837773.246894:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732036987264:0@lo:400:kworker.0 00010000:00080000:0.0:1788837773.246917:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889affc4ed80 x1875732036987776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837773.246924:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732036987776:0@lo:400:kworker.0 00000100:00100000:0.0:1788837773.246946:0:9317:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788837773.246952:0:9317:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788837773.247179:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036987136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837773.247223:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732036987136:12345-0@lo:400:kworker.0 Request processed in 456us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837773.247230:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788837773.247256:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788837773.247264:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036987648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837773.247296:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732036987648:12345-0@lo:400:kworker.0 Request processed in 33us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837773.247302:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788837773.247628:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732036987136:0@lo:400:kworker.0 00000100:00100000:0.0:1788837773.247639:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732036987648:0@lo:400:kworker.0 00000100:00080000:1.0:1788837773.247878:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837773.247882:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837773.250284:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788837773.250534:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837773.250575:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012807936 00000100:00100000:0.0:1788837773.250585:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012807936 00000100:00100000:0.0:1788837773.250635:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 174 00000100:00100000:0.0:1788837773.250645:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+51:12298:x1875732012807936:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837773.250666:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837773.250685:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefb7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec90 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837773.251248:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788837773.251370:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefb7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec90 expref: 53 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.251386:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889af8da5c00) 00010000:00010000:0.0:1788837773.251389:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837773.251395:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefb7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec90 expref: 53 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.251419:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9a400, rc 0) 00000100:00100000:0.0:1788837773.251485:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+52:12298:x1875732012807936:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 841us (952us total) trans 4294967448 rc 301/301 00000100:00100000:0.0:1788837773.251507:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 174 00000100:00100000:1.0:1788837773.257471:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837773.258974:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012808192 00000100:00100000:2.0:1788837773.258990:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012808192 00000100:00100000:2.0:1788837773.259116:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:2.0:1788837773.259128:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8e79050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+52:12298:x1875732012808192:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788837773.259510:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8e79050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+53:12298:x1875732012808192:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 376us (2039us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788837773.259519:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:2.0:1788837773.320162:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837773.320464:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012808448 00000100:00100000:0.0:1788837773.320475:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012808448 00000100:00100000:0.0:1788837773.320578:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 175 00000100:00100000:0.0:1788837773.320589:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+53:12304:x1875732012808448:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:0.0:1788837773.320616:0:14627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837773.320638:0:14627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefb88 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec97 expref: -99 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.320748:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.320765:0:14627:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefb73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec89 expref: 54 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.320794:0:14627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.320842:0:14627:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefb73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec89 expref: 54 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.320856:0:14627:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefb73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec89 expref: 54 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837773.320870:0:14627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14627:1875732036987904:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837773.320980:0:14627:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0104000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837773.322999:0:14627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14627:1875732036987904:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837773.323052:0:14627:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837773.323741:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837773.324063:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012808576 00000100:00100000:2.0:1788837773.324071:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012808576 00010000:00010000:2.0:1788837773.324110:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefb73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec89 expref: 55 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837773.324155:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 85 00000100:00100000:2.0:1788837773.324165:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+55:2395:x1875732012808576:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837773.324183:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837773.324191:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefb73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec89 expref: 55 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.324214:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefb73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec89 expref: 55 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.324253:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefb73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec89 expref: 55 pid: 6526 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.324271:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:2.0:1788837773.324275:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.324285:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.324293:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.324566:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837773.324627:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+54:2395:x1875732012808576:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 462us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837773.324635:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 85 00010000:00010000:0.0:1788837773.325621:0:14627:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.325634:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837773.325655:0:14627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788837773.325954:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefb88 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec97 expref: 55 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.325977:0:14627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec97 expref: 54 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.325987:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:0.0:1788837773.325990:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788837773.325993:0:14627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b600, rc 0) 00000100:00100000:0.0:1788837773.326187:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+54:12304:x1875732012808448:12345-192.168.201.3@tcp:101:bash.0 Request processed in 5599us (6034us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788837773.326208:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 175 00000100:00100000:3.0:1788837773.331460:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837773.331514:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012808832 00000100:00100000:0.0:1788837773.331525:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012808832 00000100:00100000:0.0:1788837773.331640:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 176 00000100:00100000:0.0:1788837773.331650:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+54:12304:x1875732012808832:12345-192.168.201.3@tcp:36:bash.0 00010000:00010000:0.0:1788837773.331930:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.331969:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.331981:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837773.332024:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:0.0:1788837773.332059:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002dafc1dc reply state 00000000acbdbf1b transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.332070:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.332077:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:0.0:1788837773.332081:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788837773.332084:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837773.332175:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+57:12304:x1875732012808832:12345-192.168.201.3@tcp:36:bash.0 Request processed in 526us (724us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788837773.332182:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 176 00000020:00080000:0.0:1788837773.332187:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788837773.336988:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837773.337146:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012808960 00000100:00100000:2.0:1788837773.337157:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012808960 00000100:00100000:2.0:1788837773.337224:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 177 00000100:00100000:2.0:1788837773.337234:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+57:12304:x1875732012808960:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788837773.337259:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837773.337280:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefba4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ec9e expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.337384:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefbab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.337417:0:9317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec97 expref: 58 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.337425:0:9317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefbab lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.337459:0:9317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec97 expref: 58 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.337473:0:9317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec97 expref: 58 pid: 14627 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837773.337488:0:9317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c24ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036988032:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837773.337577:0:9317:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c26296c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837773.343335:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837773.343473:0:9317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c24ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036988032:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837773.343503:0:9317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefbab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837773.343642:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012809088 00000100:00100000:0.0:1788837773.343650:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012809088 00010000:00010000:0.0:1788837773.343688:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec97 expref: 59 pid: 14627 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837773.343774:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 86 00000100:00100000:0.0:1788837773.343821:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+59:2396:x1875732012809088:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837773.343837:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837773.343845:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec97 expref: 59 pid: 14627 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.343871:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec97 expref: 59 pid: 14627 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.343903:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefb8f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec97 expref: 59 pid: 14627 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.343921:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:0.0:1788837773.343926:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefbab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.343935:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefbab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.343942:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefbab lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.343970:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837773.344020:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+58:2396:x1875732012809088:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 201us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837773.344028:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 86 00010000:00010000:2.0:1788837773.344076:0:9317:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefbab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.344084:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefbab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837773.344140:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788837773.344145:0:9317:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788837773.344167:0:9317:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefbab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.344215:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefba4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec9e expref: 58 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.344230:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefbab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec9e expref: 57 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.344238:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:2.0:1788837773.344240:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837773.344243:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324000, rc 0) 00000100:00100000:2.0:1788837773.344269:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+57:12304:x1875732012808960:12345-192.168.201.3@tcp:101:bash.0 Request processed in 7037us (7293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837773.344276:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 177 00000100:00100000:3.0:1788837773.347262:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837773.347305:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012809344 00000100:00100000:0.0:1788837773.347316:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012809344 00000100:00100000:0.0:1788837773.347398:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:0.0:1788837773.347406:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+57:12304:x1875732012809344:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:0.0:1788837773.347609:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+58:12304:x1875732012809344:12345-192.168.201.3@tcp:35:bash.0 Request processed in 201us (353us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788837773.347617:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:1.0:1788837773.400361:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837773.400504:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012809600 00000100:00100000:0.0:1788837773.400515:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012809600 00000100:00100000:0.0:1788837773.400577:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 178 00000100:00100000:0.0:1788837773.400589:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+58:12314:x1875732012809600:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837773.400614:0:14627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837773.400637:0:14627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefbb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eca5 expref: -99 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837773.400859:0:14627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788837773.400975:0:14627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefbb2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eca5 expref: 60 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.400990:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889af8da5c00) 00010000:00010000:0.0:1788837773.400993:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837773.401000:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefbb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eca5 expref: 60 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.401015:0:14627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b600, rc 0) 00000100:00100000:0.0:1788837773.401077:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+59:12314:x1875732012809600:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 490us (727us total) trans 4294967454 rc 301/301 00000100:00100000:0.0:1788837773.401085:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 178 00000100:00100000:3.0:1788837773.404068:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837773.404172:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012809728 00000100:00100000:0.0:1788837773.404181:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012809728 00000100:00100000:0.0:1788837773.404272:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 179 00000100:00100000:0.0:1788837773.404282:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+59:12314:x1875732012809728:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:0.0:1788837773.404367:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefbc0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404411:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefbc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404424:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefbc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404441:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefbc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404449:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404455:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404530:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefbce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404539:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefbce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404546:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefbce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837773.404592:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefbce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404605:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefbc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404617:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefbc0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404635:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefbc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404641:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837773.404645:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefbc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404653:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefbc0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404665:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:0.0:1788837773.404668:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837773.404672:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefbc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404678:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926aefbc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404692:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404697:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefbc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404702:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefbc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404706:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837773.404709:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefbc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404730:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefbc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404739:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889ac4fa7a00) 00010000:00010000:0.0:1788837773.404741:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837773.404743:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefbc7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404749:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefbc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404759:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefbce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404765:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefbce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404771:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefbce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404815:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9aa00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837773.404818:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefbce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404824:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefbce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404831:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:0.0:1788837773.404834:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837773.404837:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefbce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.404852:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefbce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837773.404927:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+59:12314:x1875732012809728:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 646us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837773.404936:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 179 00000100:00100000:3.0:1788837773.406924:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837773.407482:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012809984 00000100:00100000:2.0:1788837773.407492:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012809984 00000100:00100000:2.0:1788837773.407543:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:2.0:1788837773.407552:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+59:12314:x1875732012809984:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788837773.407762:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+60:12314:x1875732012809984:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 210us (845us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788837773.407770:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:1.0:1788837773.440317:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837773.440419:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012810240 00000100:00100000:2.0:1788837773.440430:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012810240 00000100:00100000:2.0:1788837773.440493:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 180 00000100:00100000:2.0:1788837773.440511:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+60:12317:x1875732012810240:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837773.440532:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837773.440548:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefbd5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ecac expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440621:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefbdc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440632:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefbdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440640:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefbdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440647:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefbe3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440651:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440654:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440746:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefbea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440752:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefbea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440757:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefbea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837773.440764:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788837773.440855:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefbdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440863:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefbdc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440876:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefbdc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440894:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837773.440899:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefbdc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440907:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefbdc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440923:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:2.0:1788837773.440926:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837773.440930:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefbdc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440936:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefbdc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440949:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440955:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefbe3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440960:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefbe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440965:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837773.440968:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefbe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440989:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefbe3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.440999:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889ac4fa7a00) 00010000:00010000:2.0:1788837773.441001:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837773.441005:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefbe3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.441010:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefbe3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.441044:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefbd5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecac expref: 63 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.441058:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefbea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecac expref: 62 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.441065:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:2.0:1788837773.441067:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837773.441070:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1325800, rc 0) 00000100:00100000:2.0:1788837773.441372:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+62:12317:x1875732012810240:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 868us (1064us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788837773.441380:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 180 00000100:00100000:3.0:1788837773.445369:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837773.445486:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012810496 00000100:00100000:1.0:1788837773.445496:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012810496 00000100:00100000:1.0:1788837773.445570:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:1.0:1788837773.445580:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+62:2394:x1875732012810496:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837773.445595:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837773.445619:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefbea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecac expref: 62 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837773.445639:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:1.0:1788837773.445644:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837773.445736:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+61:2394:x1875732012810496:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 157us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837773.445761:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:3.0:1788837773.454111:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837773.454303:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012810368 00000100:00100000:1.0:1788837773.454325:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012810368 00000100:00100000:1.0:1788837773.454386:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 181 00000100:00100000:1.0:1788837773.454396:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+61:12317:x1875732012810368:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:1.0:1788837773.454465:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefbf8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837773.454483:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837773.454494:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837773.454527:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837773.454535:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefbf8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837773.454542:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837773.454547:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837773.454551:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837773.454559:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837773.454571:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:1.0:1788837773.454586:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837773.454592:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefbf8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837773.454598:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefbf8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837773.454678:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+61:12317:x1875732012810368:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 283us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837773.454686:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 181 00000100:00100000:3.0:1788837773.457675:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837773.457867:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012810752 00000100:00100000:2.0:1788837773.457876:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012810752 00000100:00100000:2.0:1788837773.457950:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:2.0:1788837773.457960:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+61:12317:x1875732012810752:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788837773.458187:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+62:12317:x1875732012810752:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 228us (520us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788837773.458196:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:2.0:1788837773.611053:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837773.611214:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012811008 00000100:00100000:0.0:1788837773.611226:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012811008 00000100:00100000:0.0:1788837773.611303:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 182 00000100:00100000:0.0:1788837773.611322:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+62:12335:x1875732012811008:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:0.0:1788837773.611348:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837773.611371:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefbff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ecb3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.611469:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefc06 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.611482:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefc06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.611494:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefc06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837773.611503:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788837773.611600:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefbff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecb3 expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.611620:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefc06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecb3 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837773.611642:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:0.0:1788837773.611645:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788837773.611648:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b400, rc 0) 00000100:00100000:0.0:1788837773.611705:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+64:12335:x1875732012811008:12345-192.168.201.3@tcp:101:cat.0 Request processed in 393us (662us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788837773.611713:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 182 00000100:00100000:3.0:1788837773.638159:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837773.638410:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012811136 00000100:00100000:2.0:1788837773.638421:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012811136 00000100:00100000:2.0:1788837773.638487:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 183 00000100:00100000:2.0:1788837773.638497:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+64:12336:x1875732012811136:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837773.638520:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837773.638540:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefc14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ecba expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.638605:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefc1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.638620:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefc1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.638632:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefc1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837773.638681:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788837773.638685:0:9317:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788837773.638705:0:9317:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefc1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.638731:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefc14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecba expref: 66 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.638769:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefc1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecba expref: 65 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.638845:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:2.0:1788837773.638848:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837773.638851:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324a00, rc 0) 00000100:00100000:2.0:1788837773.638919:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+65:12336:x1875732012811136:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 424us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837773.638926:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 183 00000100:00100000:3.0:1788837773.647683:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837773.647928:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012811520 00000100:00100000:2.0:1788837773.647941:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012811520 00000100:00100000:2.0:1788837773.648007:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 48 00000100:00100000:2.0:1788837773.648017:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+65:12336:x1875732012811520:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788837773.648565:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+66:12336:x1875732012811520:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 547us (888us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788837773.648574:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 48 00000100:00100000:0.0:1788837773.651594:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837773.651675:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012811648 00000100:00100000:3.0:1788837773.651686:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012811648 00000100:00100000:3.0:1788837773.651747:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:3.0:1788837773.651756:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+66:12336:x1875732012811648:12345-192.168.201.3@tcp:103:lfs.0 00010000:00010000:3.0:1788837773.651771:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788837773.651822:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefbab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec9e expref: 66 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837773.651845:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefc06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecb3 expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837773.651858:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aefaa8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec58 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837773.651893:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:3.0:1788837773.651898:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837773.651955:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+63:12336:x1875732012811648:12345-192.168.201.3@tcp:103:lfs.0 Request processed in 200us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837773.651962:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:3.0:1788837773.655856:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837773.656118:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012811776 00000100:00100000:2.0:1788837773.656129:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012811776 00000100:00100000:2.0:1788837773.656189:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 184 00000100:00100000:2.0:1788837773.656209:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+63:12336:x1875732012811776:12345-192.168.201.3@tcp:58:lfs.0 00010000:00010000:2.0:1788837773.656335:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefc22 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.656353:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefc22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.656382:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefc22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837773.656475:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788837773.656563:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+63:12336:x1875732012811776:12345-192.168.201.3@tcp:58:lfs.0 Request processed in 363us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837773.656572:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 184 00000100:00100000:1.0:1788837773.687745:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837773.687868:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012811904 00000100:00100000:2.0:1788837773.687887:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012811904 00000100:00100000:2.0:1788837773.687955:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 185 00000100:00100000:2.0:1788837773.687966:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+63:12338:x1875732012811904:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837773.687987:0:14627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837773.688008:0:14627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325400/0x57f6d4e926aefc29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ecc1 expref: -99 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688071:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325600/0x57f6d4e926aefc30 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688097:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325600/0x57f6d4e926aefc30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688108:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325600/0x57f6d4e926aefc30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688119:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aefc37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688127:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aefc37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688152:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aefc37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688224:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefc3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688487:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefc3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688498:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefc3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837773.688538:0:14627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788837773.688543:0:14627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788837773.688560:0:14627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefc3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688571:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefc3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688579:0:14627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325600/0x57f6d4e926aefc30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688586:0:14627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325600/0x57f6d4e926aefc30 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688592:0:14627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325600/0x57f6d4e926aefc30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688598:0:14627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837773.688602:0:14627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325600/0x57f6d4e926aefc30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688617:0:14627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325600/0x57f6d4e926aefc30 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688630:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:2.0:1788837773.688634:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837773.688639:0:14627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325600/0x57f6d4e926aefc30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688645:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325600/0x57f6d4e926aefc30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688657:0:14627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aefc37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688662:0:14627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aefc37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688667:0:14627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aefc37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688671:0:14627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837773.688674:0:14627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aefc37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688679:0:14627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aefc37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688685:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889ac4fa7a00) 00010000:00010000:2.0:1788837773.688687:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837773.688690:0:14627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aefc37 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688705:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324400/0x57f6d4e926aefc37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688731:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325400/0x57f6d4e926aefc29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecc1 expref: 65 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688745:0:14627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefc3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecc1 expref: 64 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837773.688752:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:2.0:1788837773.688754:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837773.688757:0:14627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1325200, rc 0) 00000100:00100000:2.0:1788837773.688953:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+64:12338:x1875732012811904:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 988us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837773.688962:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 185 00010000:00010000:0.0:1788837774.011835:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837774.268959:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837774.268985:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036988160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837774.269079:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837774.269156:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036988160 00000100:00100000:1.0:1788837774.269164:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036988160 00000100:00100000:1.0:1788837774.269210:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788837774.269219:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036988160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788837774.269254:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788837774.269308:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036988160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837774.269316:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788837774.269528:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036988160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837774.327935:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837774.327988:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837774.328024:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837774.328034:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012812032 00000100:00100000:1.0:1788837774.328052:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837774.328079:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837774.329471:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012812032 00000100:00100000:2.0:1788837774.329538:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 385 00000100:00100000:2.0:1788837774.329549:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012812032:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837774.329626:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2395:x1875732012812032:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 80us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837774.329634:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 385 00000100:00100000:3.0:1788837774.333345:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012812160 00000100:00100000:3.0:1788837774.333360:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012812160 00000100:00100000:3.0:1788837774.333434:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012812288 00000100:00100000:3.0:1788837774.333438:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012812288 00000100:00100000:3.0:1788837774.333470:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012812800 00000100:00100000:3.0:1788837774.333474:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012812800 00000100:00100000:3.0:1788837774.333583:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 305 00000100:00100000:3.0:1788837774.333593:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+64:2396:x1875732012812160:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837774.333671:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+64:2396:x1875732012812160:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 80us (5684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837774.333679:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 305 00000100:00100000:3.0:1788837774.333698:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 306 00000100:00100000:3.0:1788837774.333704:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012812288:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837774.334028:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 307 00000100:00100000:1.0:1788837774.334041:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012812800:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837774.334076:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2395:x1875732012812288:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 370us (6051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837774.334084:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 306 00000100:00080000:3.0:1788837774.334108:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837774.335002:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012812800:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 962us (6917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837774.335013:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 307 00000100:00100000:1.0:1788837774.335050:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012812544 00000100:00100000:1.0:1788837774.335056:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012812544 00000100:00100000:1.0:1788837774.335107:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 129 00000100:00100000:1.0:1788837774.335115:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012812544:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837774.335146:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012812544:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 32us (7094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837774.335152:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 129 00000100:00080000:1.0:1788837774.336079:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837774.342167:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.342248:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837774.342280:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012812672 00000100:00100000:3.0:1788837774.342288:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012812416 00000100:00100000:2.0:1788837774.342291:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012812672 00000100:00100000:3.0:1788837774.342295:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012812416 00000100:00100000:3.0:1788837774.342364:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:2.0:1788837774.342369:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 308 00000100:00100000:3.0:1788837774.342378:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2396:x1875732012812416:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837774.342383:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012812672:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837774.342588:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012812672:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 209us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837774.342597:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 308 00000100:00100000:3.0:1788837774.343380:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2396:x1875732012812416:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 1002us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837774.343391:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00080000:3.0:1788837774.343417:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837774.343422:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788837774.392994:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837774.393004:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837774.393035:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788837774.393043:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837774.393192:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3edc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875732036988288:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788837774.393289:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837774.428339:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3edc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875732036988288:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788837774.428918:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.428948:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012812928 00000100:00100000:3.0:1788837774.428956:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012812928 00000100:00100000:3.0:1788837774.429009:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 186 00000100:00100000:3.0:1788837774.429019:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+64:12349:x1875732012812928:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788837774.429052:0:14627:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788837774.429171:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+64:12349:x1875732012812928:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 153us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837774.429179:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 186 00000040:00080000:0.0:1788837774.437149:0:14665:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837774.437159:0:14665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837774.437184:0:14665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788837774.437192:0:14665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837774.441655:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837774.444419:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012813056 00000100:00100000:1.0:1788837774.444438:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012813056 00000100:00100000:3.0:1788837774.449502:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 187 00000100:00100000:3.0:1788837774.449527:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+64:12349:x1875732012813056:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788837774.449608:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefc45 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.449628:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefc45 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.449642:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefc45 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.449695:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc4c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.449703:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.449709:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.449739:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.449747:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.449753:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837774.449825:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788837774.449829:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837774.449841:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.451854:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefc45 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.451883:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefc45 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.451892:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefc45 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.451899:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837774.451904:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefc45 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.451986:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefc45 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452005:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aded2c400) 00010000:00010000:3.0:1788837774.452008:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837774.452013:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefc45 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452020:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefc45 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452038:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452045:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc4c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452052:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc4c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452065:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837774.452564:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc4c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452575:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc4c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452586:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff889ac4fa7600) 00010000:00010000:3.0:1788837774.452588:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837774.452592:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc4c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452598:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc4c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452618:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452625:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452631:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452637:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837774.452639:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452646:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452668:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:3.0:1788837774.452671:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837774.452674:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.452680:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837774.453658:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+64:12349:x1875732012813056:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 Request processed in 4132us (12005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837774.453672:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 187 00000100:00100000:2.0:1788837774.484076:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837774.488420:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012813312 00000100:00100000:0.0:1788837774.488437:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012813312 00000100:00100000:0.0:1788837774.488509:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 188 00000100:00100000:0.0:1788837774.488520:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+64:12349:x1875732012813312:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837774.488542:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837774.488562:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefc5a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ecc8 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.488669:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefc61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.488684:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefc61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.488708:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefc61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837774.488722:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788837774.488818:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefc61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.488826:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefc61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.488833:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefc61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.488840:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9bc00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837774.488844:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefc61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.488851:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefc61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.488873:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:0.0:1788837774.488877:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837774.488882:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefc61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.488888:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefc61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.488930:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefc5a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecc8 expref: 66 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.488952:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aded2c400) 00010000:00010000:0.0:1788837774.488955:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837774.488959:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefc5a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecc8 expref: 66 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.488969:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b600, rc 0) 00000100:00100000:0.0:1788837774.489032:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+65:12349:x1875732012813312:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 514us (4968us total) trans 4294967460 rc 301/301 00000100:00100000:0.0:1788837774.489039:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 188 00000100:00100000:2.0:1788837774.493919:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.494994:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012813440 00000100:00100000:3.0:1788837774.495008:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012813440 00000100:00100000:3.0:1788837774.495081:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 189 00000100:00100000:3.0:1788837774.495091:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+65:12349:x1875732012813440:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788837774.495125:0:6526:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788837774.495256:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+65:12349:x1875732012813440:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 166us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837774.495264:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 189 00000100:00100000:0.0:1788837774.500422:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837774.500644:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012813696 00000100:00100000:2.0:1788837774.500655:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012813696 00000100:00100000:2.0:1788837774.500721:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 190 00000100:00100000:2.0:1788837774.500731:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+65:12349:x1875732012813696:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837774.500753:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837774.500757:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788837774.500804:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefc1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecba expref: 65 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.500822:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:2.0:1788837774.500827:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837774.500841:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefc6f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eccf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837774.501252:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788837774.501384:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefc76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.501397:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefc76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.501406:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefc76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.501465:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefc6f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eccf expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.501479:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefc76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eccf expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.501564:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889ac3da1d00) 00010000:00010000:2.0:1788837774.501567:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837774.501569:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1325800, rc 0) 00000100:00100000:2.0:1788837774.501632:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+66:12349:x1875732012813696:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 902us (1220us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788837774.501640:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 190 00000100:00100000:1.0:1788837774.508818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.508915:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012813952 00000100:00100000:3.0:1788837774.508925:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012813952 00000100:00100000:3.0:1788837774.508988:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 191 00000100:00100000:3.0:1788837774.508999:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+66:12349:x1875732012813952:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788837774.509057:0:14627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837774.509093:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefc76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eccf expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509134:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889ac3da1d00) 00010000:00010000:3.0:1788837774.509147:0:14627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837774.509172:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509185:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509206:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509239:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x2774c220 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509247:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2774c220 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509254:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2774c220 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509309:0:14627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509317:0:14627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc84 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509324:0:14627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509330:0:14627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837774.509334:0:14627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509350:0:14627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509373:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:3.0:1788837774.509376:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837774.509380:0:14627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc84 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509387:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefc84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509397:0:14627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2774c220 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509403:0:14627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc8b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2774c220 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509409:0:14627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2774c220 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509414:0:14627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837774.509416:0:14627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2774c220 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509422:0:14627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc8b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2774c220 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509429:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x2774c220 (ffff889ac4fa7600) 00010000:00010000:3.0:1788837774.509431:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837774.509434:0:14627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc8b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x2774c220 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.509450:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefc8b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x2774c220 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837774.509535:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+65:12349:x1875732012813952:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 537us (727us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788837774.509543:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 191 00000100:00100000:3.0:1788837774.516250:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837774.516381:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012814080 00000100:00100000:1.0:1788837774.516391:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012814080 00000100:00100000:1.0:1788837774.516449:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 192 00000100:00100000:1.0:1788837774.516458:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+65:12349:x1875732012814080:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837774.516477:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837774.516509:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aefc92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ecd6 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.516545:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefc99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.516558:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefc99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.516586:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefc99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.516686:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aefc92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecd6 expref: 67 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.516703:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefc99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecd6 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.516712:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889b01a1fb00) 00010000:00010000:1.0:1788837774.516715:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788837774.516718:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8800, rc 0) 00000100:00100000:1.0:1788837774.516770:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+66:12349:x1875732012814080:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 314us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837774.516801:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 192 00000100:00100000:1.0:1788837774.536158:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837774.543935:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012814336 00000100:00100000:0.0:1788837774.543949:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012814336 00000100:00100000:0.0:1788837774.544013:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 193 00000100:00100000:0.0:1788837774.544023:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+66:12349:x1875732012814336:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837774.544693:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefca0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.544713:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefca0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.544725:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefca0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837774.544941:0:9317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788837774.544950:0:9317:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391416173425ns, next at 392416171428ns, rc = 0 00000004:00010000:0.0:1788837774.544999:0:9317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003eb50afc reply state 00000000ce51dfe0 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefca0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.545026:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefca0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.545034:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889b01a1fb00) 00010000:00010000:0.0:1788837774.545036:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788837774.545039:0:9317:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837774.545690:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+68:12349:x1875732012814336:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 1662us (9535us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788837774.545699:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 193 00000100:00100000:1.0:1788837774.558722:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837774.562592:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012814464 00000100:00100000:0.0:1788837774.562609:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012814464 00000100:00100000:0.0:1788837774.562690:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 194 00000100:00100000:0.0:1788837774.562702:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+68:12349:x1875732012814464:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837774.562728:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837774.562751:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefca7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ecdd expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.562835:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefca7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecdd expref: 69 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.562852:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefca7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecdd expref: 69 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.562881:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889b01a1fb00) 00010000:00010000:0.0:1788837774.562885:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837774.562889:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9bc00, rc 0) 00000100:00100000:0.0:1788837774.562955:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+69:12349:x1875732012814464:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 256us (4242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837774.562971:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 194 00000100:00100000:3.0:1788837774.572248:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837774.572328:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012814592 00000100:00100000:0.0:1788837774.572339:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012814592 00000100:00100000:0.0:1788837774.572411:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:0.0:1788837774.572421:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+6:2395:x1875732012814592:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788837774.573051:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012814592:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 629us (812us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788837774.573059:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:0.0:1788837774.575714:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837774.578167:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012814848 00000100:00100000:2.0:1788837774.578184:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012814848 00000100:00100000:3.0:1788837774.581994:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 49 00000100:00100000:3.0:1788837774.582008:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+69:12349:x1875732012814848:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788837774.582250:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+70:12349:x1875732012814848:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 243us (6545us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788837774.582258:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 49 00000100:00100000:3.0:1788837774.593383:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837774.593639:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012815104 00000100:00100000:1.0:1788837774.593651:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012815104 00000100:00100000:1.0:1788837774.593717:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 195 00000100:00100000:1.0:1788837774.593727:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+70:12349:x1875732012815104:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788837774.593858:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+70:12349:x1875732012815104:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 132us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837774.593878:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 195 00000100:00100000:0.0:1788837774.600691:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.600934:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012815232 00000100:00100000:3.0:1788837774.600945:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012815232 00000100:00100000:3.0:1788837774.601006:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 196 00000100:00100000:3.0:1788837774.601017:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+70:12349:x1875732012815232:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837774.601039:0:14627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837774.601058:0:14627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefcae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ece4 expref: -99 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.601143:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.601160:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.601184:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837774.601233:0:14627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837774.601253:0:14627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.601279:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefcae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ece4 expref: 72 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.601310:0:14627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ece4 expref: 71 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.601319:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889b01a1fb00) 00010000:00010000:3.0:1788837774.601322:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788837774.601326:0:14627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17800, rc 0) 00000100:00100000:3.0:1788837774.601664:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+71:12349:x1875732012815232:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 647us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837774.601672:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 196 00000100:00100000:1.0:1788837774.613234:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837774.616961:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012815360 00000100:00100000:2.0:1788837774.616974:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012815360 00000100:00100000:2.0:1788837774.617039:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:2.0:1788837774.617050:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:2396:x1875732012815360:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837774.617082:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837774.617105:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e06fa9e/0x57f6d4e926aefcbc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eceb expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788837774.617132:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7f8e, blocks: 0x0 00010000:00010000:2.0:1788837774.617154:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=391s v=(0 0) 00010000:00010000:2.0:1788837774.617159:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837774.617168:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e06fa9e/0x57f6d4e926aefcbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eceb expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.617202:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003e06fa9e/0x57f6d4e926aefcbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eceb expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.617217:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324a00, rc 0) 00000100:00100000:2.0:1788837774.617613:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+8:2396:x1875732012815360:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 562us (4385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837774.617622:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:1.0:1788837774.624084:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.624158:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012815616 00000100:00100000:3.0:1788837774.624168:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012815616 00000100:00100000:3.0:1788837774.624222:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 197 00000100:00100000:3.0:1788837774.624232:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+71:12349:x1875732012815616:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788837774.624350:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+71:12349:x1875732012815616:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 119us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837774.624357:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 197 00000100:00100000:1.0:1788837774.629267:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.629409:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012815744 00000100:00100000:3.0:1788837774.629428:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012815744 00000100:00100000:3.0:1788837774.629497:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:3.0:1788837774.629508:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+8:12349:x1875732012815744:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837774.629526:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837774.629544:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045b015fb/0x57f6d4e926aefcc3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ecf2 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.629576:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e06fa9e/0x57f6d4e926aefcbc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eceb expref: 9 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.629585:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837774.629589:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837774.629593:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045b015fb/0x57f6d4e926aefcc3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf2 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.629627:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e06fa9e/0x57f6d4e926aefcbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eceb expref: 9 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.629641:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e06fa9e/0x57f6d4e926aefcbc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eceb expref: 9 pid: 8439 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837774.629655:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3eddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875732036988416:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788837774.629749:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788837774.635316:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837774.635351:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012815872 00000100:00100000:0.0:1788837774.635360:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012815872 00010000:00010000:0.0:1788837774.635401:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e06fa9e/0x57f6d4e926aefcbc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eceb expref: 10 pid: 8439 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837774.635437:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 87 00000100:00100000:0.0:1788837774.635448:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+10:2395:x1875732012815872:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837774.635462:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837774.635495:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e06fa9e/0x57f6d4e926aefcbc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eceb expref: 10 pid: 8439 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.635508:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e06fa9e/0x57f6d4e926aefcbc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eceb expref: 10 pid: 8439 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.635549:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837774.635554:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837774.635563:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045b015fb/0x57f6d4e926aefcc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf2 expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.635574:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045b015fb/0x57f6d4e926aefcc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf2 expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.635609:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000045b015fb/0x57f6d4e926aefcc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf2 expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837774.635623:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1875732036988544:192.168.201.3@tcp:105: 00010000:00010000:3.0:1788837774.635814:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e06fa9e/0x57f6d4e926aefcbc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eceb expref: 10 pid: 8439 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837774.635840:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3eddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875732036988416:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837774.635874:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045b015fb/0x57f6d4e926aefcc3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf2 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.635886:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16600, rc 0) 00000100:00100000:0.0:1788837774.637643:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0104780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837774.637700:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+9:12349:x1875732012815744:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 8188us (8437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837774.637711:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:1.0:1788837774.649629:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.649971:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012816000 00000100:00100000:3.0:1788837774.649982:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012816000 00002000:00100000:3.0:1788837774.650032:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8899c3dd5f80 x1875732012816000/t0(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:430/0 lens 504/0 e 0 to 0 dl 1788837785 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788837774.650044:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c3dd5f80 with x1875732012816000 ext(0->8) 00002000:00010000:3.0:1788837774.650049:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8899c3dd5f80 00000100:00100000:3.0:1788837774.650096:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:3.0:1788837774.650107:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3a879e24-3b2f-4404-84c2-9101689d9315+9:2395:x1875732012816000:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788837774.651328:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3a879e24-3b2f-4404-84c2-9101689d9315+11:2395:x1875732012816000:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 Request processed in 1218us (1704us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788837774.651339:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00002000:00100000:3.0:1788837774.651347:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8899c3dd5f80 x1875732012816000/t4294967315(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:430/0 lens 504/448 e 0 to 0 dl 1788837785 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788837774.651355:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c3dd5f80 with x1875732012816000 ext(0->8) 00002000:00010000:3.0:1788837774.651368:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8899c3dd5f80 00000100:00100000:1.0:1788837774.654221:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.655174:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012816128 00000100:00100000:3.0:1788837774.655187:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012816128 00000100:00100000:3.0:1788837774.655255:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 198 00000100:00100000:3.0:1788837774.655265:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+71:12349:x1875732012816128:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788837774.655961:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6510:1875732036988544:192.168.201.3@tcp:105: 00010000:00010000:2.0:1788837774.655985:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837774.656845:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+10:2395:x1875732012815872:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 21393us (21534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837774.656857:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 87 00000001:00080000:2.0:1788837774.660613:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:2.0:1788837774.660630:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:2.0:1788837774.660671:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788837774.660710:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788837774.660718:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff889ac5e35c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788837774.660722:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889afa679700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff889ac5e35180 00000020:00080000:2.0:1788837774.660726:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889afa679a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff889ac5602e00 00000020:00080000:2.0:1788837774.660874:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788837774.660931:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788837774.660950:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036988672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788837774.661018:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837774.661085:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036988672 00000100:00100000:2.0:1788837774.661092:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036988672 00000100:00100000:2.0:1788837774.661151:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788837774.661161:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036988672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788837774.661191:0:8544:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1788837774.661226:0:8544:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f7f8c, atime: 0x6a9f7f8c, ctime: 0x6a9f7f8c, blocks: 0x8 00010000:00010000:2.0:1788837774.661234:0:8544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089698643/0x57f6d4e926aefcca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.661250:0:8544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=391s v=(0 0) 00010000:00010000:2.0:1788837774.661255:0:8544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837774.661262:0:8544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089698643/0x57f6d4e926aefcca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.661277:0:8544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089698643/0x57f6d4e926aefcca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.661287:0:8544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089698643/0x57f6d4e926aefcca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662552:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef9eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662566:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef9eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662573:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef9eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662579:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837774.662583:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef9eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662590:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef9eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662606:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff889b01a1f700) 00010000:00010000:1.0:1788837774.662609:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837774.662613:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef9eb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662618:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aef9eb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662636:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef9f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662642:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef9f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662658:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef9f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662662:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837774.662665:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef9f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662670:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef9f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662677:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:1.0:1788837774.662680:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837774.662683:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef9f2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662688:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aef9f2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662700:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662706:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662711:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662715:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837774.662718:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662732:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662740:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889ac4fa7a00) 00010000:00010000:1.0:1788837774.662741:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837774.662744:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa31 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662750:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefa31 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662766:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefb34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662772:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefb34 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662795:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefb34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662800:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837774.662803:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefb34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662809:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefb34 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662816:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:1.0:1788837774.662819:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837774.662822:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefb34 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662837:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefb34 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662849:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefb57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662855:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefb57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662871:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefb57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662876:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837774.662879:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefb57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662884:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefb57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662892:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:1.0:1788837774.662894:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837774.662897:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefb57 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662903:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefb57 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662914:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662920:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662931:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662935:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837774.662938:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662943:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662950:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:1.0:1788837774.662952:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837774.662954:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb9d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662959:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefb9d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662971:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefca0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662978:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefca0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662984:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefca0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.662989:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837774.662991:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefca0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.663008:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefca0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.663017:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889b01a1fb00) 00010000:00010000:1.0:1788837774.663018:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788837774.663022:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefca0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.663027:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefca0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.663101:0:8544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089698643/0x57f6d4e926aefcca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.663130:0:8544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837774.663436:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837774.663443:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089698643/0x57f6d4e926aefcca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.663451:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837774.663454:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089698643/0x57f6d4e926aefcca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.663463:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089698643/0x57f6d4e926aefcca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.663476:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089698643/0x57f6d4e926aefcca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.663629:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089698643/0x57f6d4e926aefcca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.663658:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837774.663661:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837774.663662:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837774.664605:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3650:x1875732036988672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3439us (3580us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788837774.664617:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788837774.664663:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837774.664688:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036988800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788837774.664739:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788837774.664825:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8899c36de680/2, rc 0, transno 4294967308 00000100:00100000:2.0:1788837774.664832:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036988672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788837774.664957:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+19:12349:x1875732012816128:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 Request processed in 9691us (10743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837774.664966:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 198 00000100:00100000:1.0:1788837774.665753:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036988800 00000100:00100000:1.0:1788837774.665763:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036988800 00000100:00100000:1.0:1788837774.665830:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788837774.665840:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036988800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788837774.665971:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788837774.665975:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788837775 00002000:00010000:1.0:1788837774.665977:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788837774.665980:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788837774 -> 1788837775 00002000:00010000:1.0:1788837774.665982:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788837774.666035:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875732036988800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (1296us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788837774.666041:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:0.0:1788837774.667589:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8899c3eddf80/2, rc 0, transno 4294967316 00000100:00100000:0.0:1788837774.667602:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036988800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788837774.670570:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837774.671160:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012816256 00000100:00100000:0.0:1788837774.671175:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012816256 00000100:00100000:0.0:1788837774.671243:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:0.0:1788837774.671253:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+10:2396:x1875732012816256:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788837774.673239:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1788837774.673254:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1788837774.673488:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+7:2396:x1875732012816256:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 Request processed in 2220us (2913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837774.673500:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:2.0:1788837774.677416:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.677600:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012816512 00000100:00100000:3.0:1788837774.677610:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012816512 00000100:00100000:3.0:1788837774.677665:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 199 00000100:00100000:3.0:1788837774.677676:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+19:12349:x1875732012816512:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788837774.677726:0:14627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837774.677752:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ece4 expref: 19 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.677768:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889b01a1fb00) 00010000:00010000:3.0:1788837774.677773:0:14627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837774.677822:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefcd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.677836:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefcd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.677846:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefcd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837774.677976:0:14627:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff7caa99 reply state 0000000057f9c2bf transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefcd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.677988:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefcd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.678005:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889b01a1fb00) 00010000:00010000:3.0:1788837774.678008:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788837774.678011:0:14627:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837774.678122:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+20:12349:x1875732012816512:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 447us (715us total) trans 4294967464 rc 0/0 00000100:00100000:3.0:1788837774.678130:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 199 00000100:00100000:2.0:1788837774.686733:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.686915:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012816640 00000100:00100000:3.0:1788837774.686926:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012816640 00000100:00100000:3.0:1788837774.686996:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:3.0:1788837774.687006:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:2395:x1875732012816640:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788837774.687174:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788837774.687178:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788837775 -> 1788837773 00002000:00010000:3.0:1788837774.687180:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788837772 00002000:00010000:3.0:1788837774.687182:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788837775 -> 1788837773 00002000:00010000:3.0:1788837774.687185:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788837774.687248:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+8:2395:x1875732012816640:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 242us (522us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788837774.687256:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:0.0:1788837774.703950:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837774.703983:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012816896 00000100:00100000:0.0:1788837774.704074:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012816896 00000100:00100000:0.0:1788837774.704136:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 200 00000100:00100000:0.0:1788837774.704147:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+20:12349:x1875732012816896:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788837774.704221:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.704240:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefc99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecd6 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.704250:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.704287:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefc99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecd6 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.704303:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefc99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecd6 expref: 20 pid: 6525 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837774.704319:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036988928:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837774.704420:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0104e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837774.714728:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837774.714848:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036988928:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837774.714891:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837774.715047:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012817024 00000100:00100000:3.0:1788837774.715055:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012817024 00010000:00010000:3.0:1788837774.715092:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefc99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecd6 expref: 21 pid: 6525 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837774.715129:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 88 00000100:00100000:3.0:1788837774.715139:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8561450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+21:2395:x1875732012817024:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837774.715154:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837774.715173:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefc99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecd6 expref: 21 pid: 6525 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.715185:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefc99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecd6 expref: 21 pid: 6525 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.715220:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefc99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecd6 expref: 21 pid: 6525 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.715232:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889b01a1fb00) 00010000:00010000:3.0:1788837774.715237:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.715246:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.715253:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.715276:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837774.715299:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.715309:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837774.715331:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8561450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+20:2395:x1875732012817024:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 193us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837774.715340:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 88 00010000:00010000:0.0:1788837774.715358:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.715367:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.715375:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.715381:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9ae00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837774.715386:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.715394:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.715404:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889b01a1fb00) 00010000:00010000:0.0:1788837774.715407:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788837774.715411:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837774.715417:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926aefcd8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837774.715463:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+19:12349:x1875732012816896:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 Request processed in 11317us (11523us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788837774.715473:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 200 00000100:00100000:0.0:1788837774.723259:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.723331:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012817152 00000100:00100000:3.0:1788837774.723341:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012817152 00000100:00100000:3.0:1788837774.723402:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:3.0:1788837774.723413:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3a879e24-3b2f-4404-84c2-9101689d9315+8:2396:x1875732012817152:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788837774.723460:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008480f130/0x57f6d4e926aefcdf lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.724218:0:14078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000045b015fb/0x57f6d4e926aefcc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf2 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.724228:0:14078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837774.724232:0:14078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788837774.724237:0:14078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008480f130/0x57f6d4e926aefcdf lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.724276:0:14078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000045b015fb/0x57f6d4e926aefcc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf2 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.724292:0:14078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000045b015fb/0x57f6d4e926aefcc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf2 expref: 8 pid: 8440 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837774.724307:0:14078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3edd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14078:1875732036989056:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788837774.726903:0:14078:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837774.741885:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837774.741921:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012817280 00000100:00100000:1.0:1788837774.741931:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012817280 00010000:00010000:1.0:1788837774.741971:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000045b015fb/0x57f6d4e926aefcc3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf2 expref: 9 pid: 8440 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837774.742007:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 89 00000100:00100000:1.0:1788837774.742016:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+9:2395:x1875732012817280:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837774.742030:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837774.742050:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000045b015fb/0x57f6d4e926aefcc3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf2 expref: 9 pid: 8440 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837774.742721:0:14078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3edd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14078:1875732036989056:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837774.742746:0:14078:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008480f130/0x57f6d4e926aefcdf lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.742966:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000045b015fb/0x57f6d4e926aefcc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf2 expref: 9 pid: 8440 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.742990:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045b015fb/0x57f6d4e926aefcc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf2 expref: 9 pid: 8440 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.743005:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837774.743009:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837774.743015:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008480f130/0x57f6d4e926aefcdf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.743025:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008480f130/0x57f6d4e926aefcdf lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837774.743057:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837774.743411:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+8:2395:x1875732012817280:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 1394us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837774.743421:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 89 00010000:00010000:3.0:1788837774.743998:0:14078:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008480f130/0x57f6d4e926aefcdf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.744025:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008480f130/0x57f6d4e926aefcdf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.744066:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008480f130/0x57f6d4e926aefcdf lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.744074:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008480f130/0x57f6d4e926aefcdf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.744082:0:14078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008480f130/0x57f6d4e926aefcdf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.744088:0:14078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837774.744092:0:14078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008480f130/0x57f6d4e926aefcdf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.744100:0:14078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008480f130/0x57f6d4e926aefcdf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.744115:0:14078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008480f130/0x57f6d4e926aefcdf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.744123:0:14078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008480f130/0x57f6d4e926aefcdf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837774.744198:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3a879e24-3b2f-4404-84c2-9101689d9315+7:2396:x1875732012817152:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 Request processed in 20786us (20949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837774.744218:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:0.0:1788837774.760533:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837774.760613:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012817536 00000100:00100000:2.0:1788837774.760623:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012817536 00000100:00100000:2.0:1788837774.760682:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 201 00000100:00100000:2.0:1788837774.760691:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+19:12349:x1875732012817536:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788837774.760766:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.761051:0:9317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefb2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec7b expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.761062:0:9317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.761245:0:9317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefb2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec7b expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.761277:0:9317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefb2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec7b expref: 19 pid: 6525 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837774.761291:0:9317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036989184:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837774.761514:0:9317:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2629a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837774.765326:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.765535:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012817664 00000100:00100000:3.0:1788837774.765546:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012817664 00010000:00010000:3.0:1788837774.765587:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefb2d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec7b expref: 20 pid: 6525 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837774.765628:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 90 00000100:00100000:3.0:1788837774.765638:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+20:2395:x1875732012817664:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837774.765654:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837774.765661:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefb2d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec7b expref: 20 pid: 6525 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.765674:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefb2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec7b expref: 20 pid: 6525 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.765694:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:3.0:1788837774.765699:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.765708:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.765716:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.765734:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837774.765822:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+20:2395:x1875732012817664:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 185us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837774.765829:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 90 00010000:00010000:2.0:1788837774.765938:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aefb2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ec7b expref: 19 pid: 6525 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837774.765955:0:9317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036989184:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837774.765975:0:9317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.765984:0:9317:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.765989:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.766177:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.766189:0:9317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefca7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecdd expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.766198:0:9317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.766223:0:9317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefca7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecdd expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.766245:0:9317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefca7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecdd expref: 19 pid: 6526 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837774.766259:0:9317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036989312:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837774.766321:0:9317:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2629600 going to sleep for 11 seconds 00000100:00100000:2.0:1788837774.776521:0:9317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036989312:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837774.776556:0:9317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837774.779315:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837774.779446:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012817792 00000100:00100000:2.0:1788837774.779456:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012817792 00010000:00010000:2.0:1788837774.779498:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefca7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecdd expref: 20 pid: 6526 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837774.779538:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 91 00000100:00100000:2.0:1788837774.779549:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+20:2395:x1875732012817792:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837774.779565:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837774.779573:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefca7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecdd expref: 20 pid: 6526 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.779585:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefca7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecdd expref: 20 pid: 6526 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.779607:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aefca7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecdd expref: 20 pid: 6526 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.779642:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889b01a1fb00) 00010000:00010000:2.0:1788837774.779647:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.779658:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.779667:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.779699:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837774.779744:0:9317:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837774.779759:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+19:2395:x1875732012817792:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 211us (452us total) trans 0 rc 0/0 00010000:00010000:3.0:1788837774.779762:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837774.779770:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 91 00000001:00080000:3.0:1788837774.779939:0:9317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1788837774.780072:0:9317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:3.0:1788837774.780108:0:9317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1788837774.780178:0:9317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3edd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9317:1875732036989440:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788837774.780237:0:9317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837774.780268:0:9317:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae554e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837774.780283:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036989440 00000100:00100000:2.0:1788837774.780289:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036989440 00000100:00100000:2.0:1788837774.780327:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788837774.780344:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9317:x1875732036989440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788837774.780422:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9317:x1875732036989440:12345-0@lo:1000:mdt00_003.0 Request processed in 88us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837774.780429:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788837774.780546:0:9317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1788837774.780552:0:9317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8899c3eddf80, transno 4294967316 00000100:00100000:3.0:1788837774.780569:0:9317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3edd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9317:1875732036989440:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788837774.780681:0:9317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:3.0:1788837774.780719:0:9317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3edd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9317:1875732036989568:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788837774.780747:0:9317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837774.780767:0:9317:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae554e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788837774.780806:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036989568 00000100:00100000:2.0:1788837774.780812:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036989568 00000100:00100000:2.0:1788837774.780844:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788837774.780854:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9317:x1875732036989568:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788837774.780973:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9317:x1875732036989568:12345-0@lo:1000:mdt00_003.0 Request processed in 120us (224us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788837774.780991:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788837774.781475:0:9317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3edd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9317:1875732036989568:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788837774.781507:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781516:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781524:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781530:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837774.781534:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781549:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781564:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889b01a1fb00) 00010000:00010000:3.0:1788837774.781567:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837774.781571:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781577:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefced lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781598:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefc22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781604:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefc22 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781610:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefc22 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781615:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837774.781618:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefc22 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781624:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefc22 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781632:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:3.0:1788837774.781634:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837774.781637:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefc22 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781653:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aefc22 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781674:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781687:0:9317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefc3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecc1 expref: 22 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781695:0:9317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781721:0:9317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefc3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecc1 expref: 22 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.781735:0:9317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefc3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecc1 expref: 22 pid: 14627 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837774.781748:0:9317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3ede680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036989696:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837774.781892:0:9317:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837774.786843:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.786981:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012817920 00000100:00100000:3.0:1788837774.786990:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012817920 00010000:00010000:3.0:1788837774.787026:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefc3e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecc1 expref: 23 pid: 14627 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837774.787055:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 92 00000100:00100000:3.0:1788837774.787063:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+23:2396:x1875732012817920:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837774.787086:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837774.787102:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefc3e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecc1 expref: 23 pid: 14627 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.787117:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefc3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecc1 expref: 23 pid: 14627 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.787141:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:3.0:1788837774.787146:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.787155:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.787163:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.787179:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837774.787244:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+23:2396:x1875732012817920:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 181us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837774.787252:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 92 00010000:00010000:2.0:1788837774.788632:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefc3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ecc1 expref: 22 pid: 14627 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837774.788652:0:9317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3ede680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036989696:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837774.788674:0:9317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.788683:0:9317:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.788688:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.788700:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.788706:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.788713:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.788719:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837774.788723:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.788731:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.788764:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:2.0:1788837774.788766:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837774.788770:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.788968:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefcf4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.788979:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.788985:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.788991:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.788995:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837774.788999:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.789005:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.789014:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889ac4fa7f00) 00010000:00010000:2.0:1788837774.789017:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788837774.789020:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.789025:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefce6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837774.789386:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+21:12349:x1875732012817536:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 28694us (28861us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788837774.789396:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 201 00000020:00080000:2.0:1788837774.789402:0:9317:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788837774.792337:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837774.792347:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837774.792880:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788837774.792893:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788837774.795040:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837774.795186:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012818176 00000100:00100000:3.0:1788837774.795211:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012818176 00000100:00100000:3.0:1788837774.795270:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:3.0:1788837774.795280:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8e7b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+21:12349:x1875732012818176:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788837774.795527:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788837774.795561:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:3.0:1788837774.795595:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefcfb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.795613:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefcfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.795639:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefcfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.795647:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefcfb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.795652:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefcfb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.795657:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefcfb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837774.795683:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788837774.795765:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8e7b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+23:12349:x1875732012818176:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 486us (733us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788837774.795772:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 50 00000020:00080000:3.0:1788837774.795814:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788837774.796451:0:10392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837774.796460:0:10392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefcfb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.796468:0:10392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837774.796472:0:10392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefcfb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.796481:0:10392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefcfb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.796494:0:10392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889b01a1fb00) 00010000:00010000:2.0:1788837774.796497:0:10392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788837774.796501:0:10392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefcfb lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.796507:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefcfb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837774.796520:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837774.796522:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837774.796523:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837775.033291:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837776.056927:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837776.371259:0:14716:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837776.371269:0:14716:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837776.371294:0:14716:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788837776.371299:0:14716:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837776.526086:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837776.526187:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012818432 00000100:00100000:1.0:1788837776.526197:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012818432 00000100:00100000:1.0:1788837776.526273:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 202 00000100:00100000:1.0:1788837776.526284:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+23:12368:x1875732012818432:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788837776.526321:0:14627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837776.526343:0:14627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefd02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ecf9 expref: -99 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.526447:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aefd09 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.526463:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aefd09 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.526478:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aefd09 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837776.526489:0:14627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788837776.526584:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefd02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf9 expref: 26 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.526601:0:14627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aefd09 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf9 expref: 25 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.526611:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:1.0:1788837776.526614:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788837776.526617:0:14627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8200, rc 0) 00000100:00100000:1.0:1788837776.526670:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+25:12368:x1875732012818432:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 389us (592us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788837776.526677:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 202 00000100:00080000:2.0:1788837776.526905:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837776.528748:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837776.528884:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012818560 00000100:00100000:2.0:1788837776.528894:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012818560 00000100:00100000:2.0:1788837776.528946:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 203 00000100:00100000:2.0:1788837776.528956:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+25:12368:x1875732012818560:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:2.0:1788837776.529024:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd17 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529053:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529064:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529080:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529086:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529092:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529168:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefd25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529178:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefd25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529184:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefd25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837776.529250:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefd25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529263:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529270:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd17 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529276:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529282:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837776.529286:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529293:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd17 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529305:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:2.0:1788837776.529307:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837776.529312:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529317:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529329:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529334:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529346:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529351:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837776.529354:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529359:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529366:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889afa694a00) 00010000:00010000:2.0:1788837776.529368:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837776.529370:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529375:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529387:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefd25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529393:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefd25 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529398:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefd25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529402:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837776.529405:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefd25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529418:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefd25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529425:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694c00) 00010000:00010000:2.0:1788837776.529427:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837776.529430:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefd25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.529435:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefd25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837776.529496:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+25:12368:x1875732012818560:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 541us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837776.529503:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 203 00000100:00100000:2.0:1788837776.598640:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837776.598670:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012818816 00000100:00100000:2.0:1788837776.598680:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012818816 00000100:00100000:2.0:1788837776.599453:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 204 00000100:00100000:2.0:1788837776.599467:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+25:12371:x1875732012818816:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837776.599488:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837776.599508:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefd2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed00 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.599576:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd33 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.599590:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.599616:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.599631:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.599639:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.599646:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.600605:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325400/0x57f6d4e926aefd41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.600619:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325400/0x57f6d4e926aefd41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.600628:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325400/0x57f6d4e926aefd41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837776.600639:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788837776.600835:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.600843:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd33 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.600849:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.600854:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837776.600867:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.600874:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd33 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.600886:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:2.0:1788837776.600888:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837776.600892:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.601177:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325800/0x57f6d4e926aefd33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.601353:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.601362:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.601369:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.601375:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837776.601379:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.601386:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.601396:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889afa694c00) 00010000:00010000:2.0:1788837776.601399:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837776.601408:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.601414:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324600/0x57f6d4e926aefd3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.601460:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324000/0x57f6d4e926aefd2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed00 expref: 28 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.601473:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325400/0x57f6d4e926aefd41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed00 expref: 27 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.601480:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:2.0:1788837776.601482:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837776.601485:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1325400, rc 0) 00000100:00100000:2.0:1788837776.601553:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+27:12371:x1875732012818816:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 2090us (2919us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788837776.601562:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 204 00000100:00100000:1.0:1788837776.606860:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837776.606967:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012818944 00000100:00100000:3.0:1788837776.606977:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012818944 00000100:00100000:3.0:1788837776.607036:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 205 00000100:00100000:3.0:1788837776.607048:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+27:12371:x1875732012818944:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:3.0:1788837776.607120:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefd4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.607159:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefd4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.607172:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefd4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.607219:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefd4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.607227:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefd4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.607234:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefd4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.607240:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837776.607244:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefd4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.607251:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefd4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.607262:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:3.0:1788837776.607265:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837776.607269:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefd4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.607275:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefd4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837776.607348:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+27:12371:x1875732012818944:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 303us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837776.607362:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 205 00000100:00100000:2.0:1788837776.609885:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837776.609952:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012819200 00000100:00100000:1.0:1788837776.609975:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012819200 00000100:00100000:1.0:1788837776.610032:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:1.0:1788837776.610042:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+27:12371:x1875732012819200:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:1.0:1788837776.610264:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+28:12371:x1875732012819200:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 222us (388us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788837776.610272:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:0.0:1788837776.650142:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837776.650245:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012819456 00000100:00100000:3.0:1788837776.650267:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012819456 00000100:00100000:3.0:1788837776.650334:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 206 00000100:00100000:3.0:1788837776.650344:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+28:11895:x1875732012819456:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788837776.650368:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837776.650389:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefd56 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed07 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.650496:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.650511:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325400/0x57f6d4e926aefd41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed00 expref: 29 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.650520:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.650554:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325400/0x57f6d4e926aefd41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed00 expref: 29 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.650568:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325400/0x57f6d4e926aefd41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed00 expref: 29 pid: 9317 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837776.650582:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3edc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036989824:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788837776.650684:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230540 going to sleep for 11 seconds 00000100:00100000:3.0:1788837776.654182:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3edc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036989824:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837776.654238:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837776.654910:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837776.654990:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012819584 00000100:00100000:1.0:1788837776.654999:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012819584 00010000:00010000:1.0:1788837776.655048:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325400/0x57f6d4e926aefd41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed00 expref: 30 pid: 9317 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837776.655091:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 93 00000100:00100000:1.0:1788837776.655101:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+30:2395:x1875732012819584:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837776.655116:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837776.655124:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325400/0x57f6d4e926aefd41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed00 expref: 30 pid: 9317 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.655137:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325400/0x57f6d4e926aefd41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed00 expref: 30 pid: 9317 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.655158:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325400/0x57f6d4e926aefd41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed00 expref: 30 pid: 9317 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.655173:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:1.0:1788837776.655178:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.655187:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.655218:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.655242:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837776.655309:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+29:2395:x1875732012819584:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 208us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837776.655317:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 93 00010000:00010000:3.0:1788837776.656237:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.656250:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837776.656383:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788837776.656508:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefd56 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed07 expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.656526:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed07 expref: 29 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.656535:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:3.0:1788837776.656538:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788837776.656542:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17800, rc 0) 00000100:00100000:3.0:1788837776.656578:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+29:11895:x1875732012819456:12345-192.168.201.3@tcp:101:bash.0 Request processed in 6236us (6446us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788837776.656586:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 206 00000100:00100000:2.0:1788837776.659431:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837776.659509:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012819712 00000100:00100000:1.0:1788837776.659537:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012819712 00000100:00100000:1.0:1788837776.659626:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 207 00000100:00100000:1.0:1788837776.659637:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+29:11895:x1875732012819712:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788837776.659661:0:14627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837776.659681:0:14627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefd6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed0e expref: -99 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.659715:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefd72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.659731:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefd72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.659743:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefd72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.659906:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefd6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed0e expref: 31 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.659925:0:14627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefd72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed0e expref: 30 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.659941:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:1.0:1788837776.659945:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788837776.659948:0:14627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8c00, rc 0) 00000100:00100000:1.0:1788837776.659998:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+30:11895:x1875732012819712:12345-192.168.201.3@tcp:101:bash.0 Request processed in 363us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837776.660006:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 207 00000100:00100000:1.0:1788837776.668651:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837776.671129:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012819968 00000100:00100000:3.0:1788837776.671144:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012819968 00000100:00100000:3.0:1788837776.671375:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 208 00000100:00100000:3.0:1788837776.671386:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+30:11895:x1875732012819968:12345-192.168.201.3@tcp:36:bash.0 00010000:00010000:3.0:1788837776.671599:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefd79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.671634:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefd79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.671646:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefd79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837776.671690:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:3.0:1788837776.671710:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000615b7c13 reply state 000000009113f5a4 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefd79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.671723:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefd79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.671730:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:3.0:1788837776.671734:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788837776.671737:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788837776.671771:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:3.0:1788837776.672044:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+34:11895:x1875732012819968:12345-192.168.201.3@tcp:36:bash.0 Request processed in 659us (3401us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788837776.672052:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 208 00000020:00080000:3.0:1788837776.672058:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788837776.674334:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837776.674409:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012820096 00000100:00100000:3.0:1788837776.674419:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012820096 00000100:00100000:3.0:1788837776.674471:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 209 00000100:00100000:3.0:1788837776.674481:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+34:11895:x1875732012820096:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788837776.674500:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837776.674517:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefd80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed15 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.674580:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefd80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed15 expref: 35 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.674593:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefd80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed15 expref: 35 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.674611:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:3.0:1788837776.674613:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837776.674617:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16800, rc 0) 00000100:00100000:3.0:1788837776.674754:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+35:11895:x1875732012820096:12345-192.168.201.3@tcp:101:bash.0 Request processed in 273us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837776.674762:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 209 00000100:00100000:2.0:1788837776.677197:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837776.677293:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012820224 00000100:00100000:0.0:1788837776.677302:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012820224 00000100:00100000:0.0:1788837776.677367:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:0.0:1788837776.677377:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+7:11895:x1875732012820224:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:0.0:1788837776.677390:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837776.677410:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926aefd87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed1c expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788837776.677435:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f7f8d, atime: 0x6a9f7f8c, ctime: 0x6a9f7f8d, blocks: 0x8 00010000:00010000:0.0:1788837776.677454:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788837776.677458:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837776.677466:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926aefd87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed1c expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.677483:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926aefd87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed1c expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.677495:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b800, rc 0) 00000100:00100000:0.0:1788837776.677549:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+8:11895:x1875732012820224:12345-192.168.201.3@tcp:101:bash.0 Request processed in 173us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837776.677556:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00080000:2.0:1788837776.677959:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837776.680030:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837776.680162:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012820352 00000100:00100000:2.0:1788837776.680171:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012820352 00002000:00010000:2.0:1788837776.680208:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788837776.680213:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c44caa00 with x1875732012820352 ext(0->18446744073709551615) 00002000:00010000:2.0:1788837776.680224:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8899c44caa00. 00000100:00100000:2.0:1788837776.680254:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:2.0:1788837776.680264:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3a879e24-3b2f-4404-84c2-9101689d9315+8:2395:x1875732012820352:12345-192.168.201.3@tcp:10:bash.0 00002000:00010000:2.0:1788837776.680545:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788837776.680550:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788837773 -> 1788837777 00002000:00010000:2.0:1788837776.680552:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788837772 -> 1788837772 00002000:00010000:2.0:1788837776.680554:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788837773 -> 1788837777 00002000:00010000:2.0:1788837776.680557:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788837776.680708:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3a879e24-3b2f-4404-84c2-9101689d9315+9:2395:x1875732012820352:12345-192.168.201.3@tcp:10:bash.0 Request processed in 445us (685us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788837776.680716:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00002000:00010000:2.0:1788837776.680720:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788837776.680723:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c44caa00 with x1875732012820352 ext(0->18446744073709551615) 00002000:00010000:2.0:1788837776.680728:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8899c44caa00. 00000100:00100000:3.0:1788837776.745366:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837776.745483:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012820480 00000100:00100000:1.0:1788837776.745503:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012820480 00000100:00100000:1.0:1788837776.745568:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 210 00000100:00100000:1.0:1788837776.745579:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+35:12385:x1875732012820480:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:1.0:1788837776.745656:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefd8e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.745675:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefd8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.745687:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefd8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.745703:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefd95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.745710:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefd95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.745718:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefd95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.745876:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefd9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.745887:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefd9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.745894:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefd9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837776.745938:0:14627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefd9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.745950:0:14627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefd8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.745957:0:14627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefd8e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.745965:0:14627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefd8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.745971:0:14627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837776.745975:0:14627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefd8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.745984:0:14627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefd8e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.745995:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:1.0:1788837776.745998:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837776.746003:0:14627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefd8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746016:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefd8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746031:0:14627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefd95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746038:0:14627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefd95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746044:0:14627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefd95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746050:0:14627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837776.746053:0:14627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefd95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746059:0:14627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefd95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746066:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889b01a1f700) 00010000:00010000:1.0:1788837776.746068:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837776.746071:0:14627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefd95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746076:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefd95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746091:0:14627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefd9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746098:0:14627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefd9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746109:0:14627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefd9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746114:0:14627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837776.746116:0:14627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefd9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746122:0:14627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefd9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746129:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:1.0:1788837776.746132:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837776.746135:0:14627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefd9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.746141:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefd9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837776.746212:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+35:12385:x1875732012820480:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 635us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837776.746220:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 210 00000100:00100000:3.0:1788837776.790308:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837776.790604:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012820736 00000100:00100000:0.0:1788837776.790613:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012820736 00000100:00100000:0.0:1788837776.790674:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 211 00000100:00100000:0.0:1788837776.790680:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+35:12388:x1875732012820736:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837776.790699:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837776.790715:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefda3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed23 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.790950:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdaa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.790964:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.790973:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791033:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791100:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791106:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791302:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefdb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791310:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefdb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791315:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefdb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837776.791332:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788837776.791403:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791408:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdaa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791412:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791415:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837776.791419:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791423:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdaa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791432:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:0.0:1788837776.791434:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837776.791437:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdaa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791441:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdaa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791454:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791460:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791475:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791481:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837776.791484:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791490:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791498:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889af8da5100) 00010000:00010000:0.0:1788837776.791500:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837776.791502:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791508:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791545:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefda3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed23 expref: 38 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791558:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefdb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed23 expref: 37 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.791566:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:0.0:1788837776.791568:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788837776.791570:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9a800, rc 0) 00000100:00100000:0.0:1788837776.791735:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+37:12388:x1875732012820736:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 1053us (1437us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788837776.791750:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 211 00000100:00100000:2.0:1788837776.800346:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837776.801327:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012820864 00000100:00100000:3.0:1788837776.801339:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012820864 00000100:00100000:3.0:1788837776.801407:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 212 00000100:00100000:3.0:1788837776.801418:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+37:12388:x1875732012820864:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:3.0:1788837776.801485:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.801502:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed07 expref: 37 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.801509:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.801554:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed07 expref: 37 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.801564:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed07 expref: 37 pid: 6525 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837776.801575:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3edf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036989952:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788837776.801650:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837776.804596:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3edf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6525:1875732036989952:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788837776.804621:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837776.804704:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837776.804757:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012821120 00000100:00100000:1.0:1788837776.804762:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012821120 00000100:00100000:1.0:1788837776.804838:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:1.0:1788837776.804848:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+38:6165:x1875732012821120:12345-192.168.201.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788837776.805121:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+39:6165:x1875732012821120:12345-192.168.201.3@tcp:35:ldlm_bl.0 Request processed in 273us (416us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788837776.805130:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:2.0:1788837776.809277:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837776.809371:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012821248 00000100:00100000:3.0:1788837776.809382:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012821248 00010000:00010000:3.0:1788837776.809424:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed07 expref: 39 pid: 6525 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837776.809467:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 94 00000100:00100000:3.0:1788837776.809484:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+39:2396:x1875732012821248:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837776.809626:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837776.809633:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed07 expref: 39 pid: 6525 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.809643:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed07 expref: 39 pid: 6525 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.809661:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aefd5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed07 expref: 39 pid: 6525 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.809685:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:3.0:1788837776.809689:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.809696:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.809701:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.809725:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837776.809772:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+38:2396:x1875732012821248:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 298us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837776.809811:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 94 00010000:00010000:1.0:1788837776.810028:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.810037:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.810075:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.810082:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.810089:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.810096:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837776.810100:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.810108:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.810118:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:1.0:1788837776.810121:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837776.810124:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.810129:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926aefdc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837776.810192:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+37:12388:x1875732012820864:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 8776us (9856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837776.810200:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 212 00000100:00100000:2.0:1788837776.812102:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837776.812197:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012821504 00000100:00100000:0.0:1788837776.812207:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012821504 00000100:00100000:0.0:1788837776.812255:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:0.0:1788837776.812265:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+37:12388:x1875732012821504:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:0.0:1788837776.812455:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+38:12388:x1875732012821504:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 192us (361us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788837776.812460:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:3.0:1788837776.825718:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036990080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837776.825818:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837776.826002:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036990080 00000100:00100000:0.0:1788837776.826010:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036990080 00000100:00100000:0.0:1788837776.826078:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788837776.826087:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036990080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837776.826116:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788837776.826163:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036990080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837776.826170:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1788837776.826255:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837776.826288:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036990080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837776.826625:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036990208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837776.826656:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837776.826806:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036990208 00000100:00100000:2.0:1788837776.826811:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036990208 00000100:00100000:2.0:1788837776.826861:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788837776.826868:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036990208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837776.826880:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00080000:3.0:1788837776.827025:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837776.827088:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036990208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 220us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837776.827096:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788837776.827157:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036990208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837776.901593:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837776.901717:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012821760 00000100:00100000:0.0:1788837776.901726:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012821760 00000100:00100000:0.0:1788837776.901817:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 213 00000100:00100000:0.0:1788837776.901839:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+38:12399:x1875732012821760:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:0.0:1788837776.901864:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837776.901884:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefdcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed2a expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.901961:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdd4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.901973:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.901980:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.901989:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefddb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.901993:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.901997:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902099:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefde2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902107:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902114:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837776.902123:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788837776.902188:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902194:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdd4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902207:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902213:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837776.902218:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902226:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdd4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902239:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:0.0:1788837776.902242:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837776.902247:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902253:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902267:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902273:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefddb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902278:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefddb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902283:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837776.902285:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefddb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902301:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefddb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902310:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889af8da5100) 00010000:00010000:0.0:1788837776.902312:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837776.902315:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefddb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902320:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefddb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902358:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefdcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed2a expref: 41 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902372:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefde2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed2a expref: 40 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.902379:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:0.0:1788837776.902381:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837776.902383:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9ba00, rc 0) 00000100:00100000:0.0:1788837776.902446:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+40:12399:x1875732012821760:12345-192.168.201.3@tcp:101:cat.0 Request processed in 611us (860us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788837776.902454:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 213 00000100:00100000:2.0:1788837776.907652:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837776.907835:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012822016 00000100:00100000:0.0:1788837776.907845:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012822016 00000100:00100000:0.0:1788837776.907900:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:0.0:1788837776.907907:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+40:12399:x1875732012822016:12345-192.168.201.3@tcp:35:cat.0 00000100:00100000:0.0:1788837776.908279:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+41:12399:x1875732012822016:12345-192.168.201.3@tcp:35:cat.0 Request processed in 370us (635us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788837776.908287:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:3.0:1788837776.932763:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837776.932913:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012822272 00000100:00100000:0.0:1788837776.932924:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012822272 00000100:00100000:0.0:1788837776.932978:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 214 00000100:00100000:0.0:1788837776.932987:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+41:12400:x1875732012822272:12345-192.168.201.3@tcp:36:rm.0 00010000:00010000:0.0:1788837776.933063:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788837776.933091:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926aefd80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed15 expref: 41 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933115:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefde2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed2a expref: 40 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933128:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefdb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed23 expref: 39 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933143:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefd72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed0e expref: 38 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933153:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:0.0:1788837776.933158:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837776.933180:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefdf0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933195:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefdf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933237:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefdf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933263:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdf7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933272:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933279:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933354:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdfe lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933363:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdfe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933369:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdfe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837776.933566:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788837776.933576:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 393804798924ns, next at 394804796658ns, rc = 0 00010000:00010000:0.0:1788837776.933620:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefe05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933628:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefe05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933635:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefe05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933652:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefe05 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933658:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefe05 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933663:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefe05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933686:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837776.933703:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdfe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933709:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdfe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933715:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdfe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933720:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837776.933724:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdfe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933730:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdfe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933739:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:0.0:1788837776.933741:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788837776.933746:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdfe lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933762:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefdfe lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933828:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefdf0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933836:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefdf0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933842:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefdf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933847:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837776.933851:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefdf0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933857:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefdf0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933865:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:0.0:1788837776.933868:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837776.933871:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefdf0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933876:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aefdf0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837776.933884:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001085bcab reply state 000000007ce2a583 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933895:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdf7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837776.933908:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889af8da5100) 00010000:00010000:0.0:1788837776.933910:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788837776.933913:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837776.933992:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+39:12400:x1875732012822272:12345-192.168.201.3@tcp:36:rm.0 Request processed in 1003us (1235us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788837776.933999:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 214 00010000:00010000:2.0:1788837776.935074:0:10392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837776.935083:0:10392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefe05 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.935102:0:10392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9aa00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837776.935106:0:10392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefe05 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.935113:0:10392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefe05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.935128:0:10392:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:2.0:1788837776.935130:0:10392:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788837776.935134:0:10392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefe05 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.935140:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926aefe05 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.935154:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837776.935156:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837776.935158:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837776.980998:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837776.981089:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012822528 00000100:00100000:1.0:1788837776.981098:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012822528 00000100:00100000:1.0:1788837776.981155:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 215 00000100:00100000:1.0:1788837776.981163:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+39:12406:x1875732012822528:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788837776.981182:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837776.981199:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefe0c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed31 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981301:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe13 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981313:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981321:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981329:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefe1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981334:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefe1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981338:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefe1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788837776.981605:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788837776.981702:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefe21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981708:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefe21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981713:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefe21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981734:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981739:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe13 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981743:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe13 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981747:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837776.981749:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe13 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981754:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe13 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981761:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:1.0:1788837776.981763:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837776.981766:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe13 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981813:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe13 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837776.981837:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd07e669 reply state 00000000cc1a9805 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefe1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981848:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefe1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981853:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889af8da5100) 00010000:00010000:1.0:1788837776.981854:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788837776.981856:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788837776.981877:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefe0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed31 expref: 42 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981886:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefe21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed31 expref: 41 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.981890:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f700) 00010000:00010000:1.0:1788837776.981989:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837776.981991:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9200, rc 0) 00000100:00100000:1.0:1788837776.982051:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+42:12406:x1875732012822528:12345-192.168.201.3@tcp:101:bash.0 Request processed in 887us (1059us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788837776.982058:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 215 00000100:00100000:3.0:1788837776.985299:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837776.985406:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012822656 00000100:00100000:2.0:1788837776.985416:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012822656 00000100:00100000:2.0:1788837776.985492:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:2.0:1788837776.985503:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:2394:x1875732012822656:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788837776.985518:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837776.985538:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000796b7391/0x57f6d4e926aefe2f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed38 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788837776.985562:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837776.985581:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788837776.985600:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837776.985609:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000796b7391/0x57f6d4e926aefe2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed38 expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.985629:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000796b7391/0x57f6d4e926aefe2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed38 expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.985643:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324200, rc 0) 00000100:00100000:2.0:1788837776.985701:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+8:2394:x1875732012822656:12345-192.168.201.3@tcp:101:bash.0 Request processed in 200us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837776.985708:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00080000:3.0:1788837776.985768:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837776.989135:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837776.989305:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012822784 00000100:00100000:1.0:1788837776.989316:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012822784 00000100:00100000:1.0:1788837776.989374:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:1.0:1788837776.989384:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3a879e24-3b2f-4404-84c2-9101689d9315+8:12406:x1875732012822784:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788837776.989415:0:14078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837776.989433:0:14078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed3f expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.989462:0:14078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000796b7391/0x57f6d4e926aefe2f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed38 expref: 9 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.989472:0:14078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837776.989476:0:14078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837776.989481:0:14078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 9 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.989515:0:14078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000796b7391/0x57f6d4e926aefe2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed38 expref: 9 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837776.989528:0:14078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000796b7391/0x57f6d4e926aefe2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed38 expref: 9 pid: 8441 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837776.989543:0:14078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14078:1875732036990336:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788837776.989643:0:14078:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837776.992687:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837776.992831:0:14078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14078:1875732036990336:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837776.992887:0:14078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 9 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837776.992909:0:14078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9000, rc 0) 00000100:00100000:3.0:1788837776.992976:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3a879e24-3b2f-4404-84c2-9101689d9315+9:12406:x1875732012822784:12345-192.168.201.3@tcp:101:bash.0 Request processed in 3592us (3851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837776.992986:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:2.0:1788837776.993244:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012822912 00000100:00100000:2.0:1788837776.993262:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012822912 00010000:00010000:2.0:1788837776.993295:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000796b7391/0x57f6d4e926aefe2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed38 expref: 9 pid: 8441 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837776.993330:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 95 00000100:00100000:2.0:1788837776.993340:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+9:2396:x1875732012822912:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837776.993353:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837776.993373:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000796b7391/0x57f6d4e926aefe2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed38 expref: 9 pid: 8441 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.993387:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000796b7391/0x57f6d4e926aefe2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed38 expref: 9 pid: 8441 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.993410:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000796b7391/0x57f6d4e926aefe2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed38 expref: 9 pid: 8441 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.993432:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837776.993436:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837776.993445:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 8 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.993456:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 8 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837776.993489:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 8 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837776.993502:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6510:1875732036990464:192.168.201.3@tcp:105: 00000100:00100000:2.0:1788837776.993556:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2629540 going to sleep for 11 seconds 00000100:00100000:2.0:1788837776.996489:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6510:1875732036990464:192.168.201.3@tcp:105: 00010000:00010000:2.0:1788837776.996516:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837776.996571:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+8:2396:x1875732012822912:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 3232us (3893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837776.996581:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 95 00000100:00100000:0.0:1788837776.999658:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837776.999829:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012823168 00000100:00100000:1.0:1788837776.999840:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012823168 00000100:00100000:1.0:1788837776.999900:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:1.0:1788837776.999911:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+42:12406:x1875732012823168:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:1.0:1788837777.000224:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+43:12406:x1875732012823168:12345-192.168.201.3@tcp:35:bash.0 Request processed in 314us (576us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1788837777.000246:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 55 00010000:00010000:0.0:1788837777.083910:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837777.160097:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837777.160244:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012823296 00000100:00100000:2.0:1788837777.160270:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012823296 00000100:00100000:2.0:1788837777.160332:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 216 00000100:00100000:2.0:1788837777.160343:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+43:12422:x1875732012823296:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837777.160366:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837777.160386:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aefe3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed46 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.160482:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefe44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.160497:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefe44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.160511:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefe44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837777.160554:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788837777.160558:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788837777.160575:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefe44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.160600:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324200/0x57f6d4e926aefe3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed46 expref: 45 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.160619:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefe44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed46 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.160628:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:2.0:1788837777.160631:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837777.160635:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324a00, rc 0) 00000100:00100000:2.0:1788837777.160698:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+44:12422:x1875732012823296:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 357us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837777.160707:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 216 00000100:00100000:3.0:1788837777.167224:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.167321:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012823552 00000100:00100000:0.0:1788837777.167331:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012823552 00000100:00100000:0.0:1788837777.167396:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 217 00000100:00100000:0.0:1788837777.167407:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad1162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+44:12422:x1875732012823552:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837777.167425:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837777.167446:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed4d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.167551:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.167566:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.167578:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837777.167587:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788837777.167684:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed4d expref: 47 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.167723:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed4d expref: 46 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.167745:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f700) 00010000:00010000:0.0:1788837777.167748:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837777.167752:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9ba00, rc 0) 00000100:00100000:0.0:1788837777.167881:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad1162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+46:12422:x1875732012823552:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 475us (664us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1788837777.168158:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 217 00000100:00100000:1.0:1788837777.174238:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.174285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837777.174439:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012823808 00000100:00100000:2.0:1788837777.174451:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012823808 00000100:00100000:2.0:1788837777.174528:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 218 00000100:00100000:2.0:1788837777.174538:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+46:12422:x1875732012823808:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837777.174564:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837777.174586:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefe60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed54 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.174693:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefe67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.174707:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefe67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.174718:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefe67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837777.174719:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012823936 00000100:00100000:3.0:1788837777.174724:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012823936 00000004:00200000:2.0:1788837777.174730:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000100:00100000:3.0:1788837777.174761:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788837777.174767:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+48:2396:x1875732012823936:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837777.174801:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837777.174828:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed4d expref: 49 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.174844:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f700) 00010000:00010000:3.0:1788837777.174849:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837777.174956:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefe60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed54 expref: 49 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.174971:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefe67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed54 expref: 48 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.174979:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f700) 00010000:00010000:2.0:1788837777.174982:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788837777.174984:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324e00, rc 0) 00000100:00100000:2.0:1788837777.175043:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+48:12422:x1875732012823808:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 506us (814us total) trans 4294967488 rc 0/0 00000100:00100000:3.0:1788837777.175044:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+48:2396:x1875732012823936:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 274us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837777.175051:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:2.0:1788837777.175051:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 218 00000100:00100000:2.0:1788837777.181167:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.181590:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012824064 00000100:00100000:1.0:1788837777.181601:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012824064 00000100:00100000:1.0:1788837777.181664:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:1.0:1788837777.181674:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+8:2394:x1875732012824064:12345-192.168.201.3@tcp:1:lfs.0 00010000:00010000:1.0:1788837777.181718:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926aefe75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.181746:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 8 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.181755:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788837777.181759:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837777.181764:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926aefe75 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.181842:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 8 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.181858:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 8 pid: 14078 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837777.181873:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1875732036990592:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788837777.181982:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788837777.185429:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.185536:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1875732036990592:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788837777.185562:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926aefe75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837777.185668:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012824192 00000100:00100000:3.0:1788837777.185675:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012824192 00002000:00100000:3.0:1788837777.185721:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8899c446d180 x1875732012824192/t0(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:433/0 lens 504/0 e 0 to 0 dl 1788837788 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788837777.185732:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c446d180 with x1875732012824192 ext(0->8) 00010000:00010000:3.0:1788837777.185753:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 9 pid: 14078 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.185769:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 9 pid: 14078 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837777.185811:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8899c446d180 00000100:00100000:3.0:1788837777.185850:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:3.0:1788837777.185860:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3a879e24-3b2f-4404-84c2-9101689d9315+9:2396:x1875732012824192:12345-192.168.201.3@tcp:4:lfs.0 00000100:00100000:3.0:1788837777.186705:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3a879e24-3b2f-4404-84c2-9101689d9315+11:2396:x1875732012824192:12345-192.168.201.3@tcp:4:lfs.0 Request processed in 843us (1282us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788837777.186715:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00002000:00100000:3.0:1788837777.186723:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8899c446d180 x1875732012824192/t4294967309(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:433/0 lens 504/448 e 0 to 0 dl 1788837788 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788837777.186732:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c446d180 with x1875732012824192 ext(0->8) 00010000:00010000:3.0:1788837777.186738:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 11 pid: 14078 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.186752:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 11 pid: 14078 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837777.186760:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8899c446d180 00000001:00080000:0.0:1788837777.187846:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1788837777.187859:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1788837777.189955:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.190012:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012824320 00000100:00100000:1.0:1788837777.190022:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012824320 00010000:00010000:1.0:1788837777.190061:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 7 pid: 14078 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837777.190151:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 96 00000100:00100000:1.0:1788837777.190163:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:2393:x1875732012824320:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837777.190179:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788837777.190210:0:6511:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788837777.190214:0:6511:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788837777 00002000:00010000:1.0:1788837777.190216:0:6511:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788837777 00002000:00010000:1.0:1788837777.190219:0:6511:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788837777 00002000:00010000:1.0:1788837777.190221:0:6511:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788837777.190229:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 7 pid: 14078 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.190242:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 7 pid: 14078 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.190277:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbfe38d7/0x57f6d4e926aefe36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed3f expref: 7 pid: 14078 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.190316:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837777.190321:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837777.190327:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926aefe75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.190336:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926aefe75 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.190373:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837777.190433:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+6:2393:x1875732012824320:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 273us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837777.190441:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 96 00010000:00010000:3.0:1788837777.190490:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926aefe75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.190500:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926aefe75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.190528:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926aefe75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.190536:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926aefe75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.190544:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926aefe75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.190550:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837777.190554:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926aefe75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.190563:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926aefe75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.190575:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926aefe75 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.190583:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926aefe75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837777.190644:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2394:x1875732012824064:12345-192.168.201.3@tcp:1:lfs.0 Request processed in 8971us (9486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837777.190652:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:2.0:1788837777.194413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.194539:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012824576 00000100:00100000:1.0:1788837777.194549:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012824576 00000100:00100000:1.0:1788837777.194648:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:1.0:1788837777.194660:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aded56850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+47:12422:x1875732012824576:12345-192.168.201.3@tcp:35:lfs.0 00000004:00010000:1.0:1788837777.194727:0:6528:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefe67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed54 expref: 47 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788837777.194934:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788837777.194967:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1788837777.195274:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:1.0:1788837777.195313:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.195328:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefe21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed31 expref: 51 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.195350:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.195382:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefe21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed31 expref: 51 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.195397:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefe21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed31 expref: 51 pid: 6525 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837777.195410:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1875732036990720:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788837777.195492:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae554e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788837777.200319:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837777.200393:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012824704 00000100:00100000:3.0:1788837777.200402:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012824704 00010000:00010000:3.0:1788837777.200442:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefe21 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed31 expref: 52 pid: 6525 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837777.200482:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 97 00000100:00100000:3.0:1788837777.200493:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+52:2395:x1875732012824704:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837777.200507:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837777.200514:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefe21 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed31 expref: 52 pid: 6525 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.200527:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefe21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed31 expref: 52 pid: 6525 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.200548:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f700) 00010000:00010000:3.0:1788837777.200555:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.200565:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.200572:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.200591:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837777.200646:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+52:2395:x1875732012824704:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 155us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837777.200654:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 97 00010000:00010000:1.0:1788837777.200938:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefe21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed31 expref: 51 pid: 6525 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837777.200957:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6528:1875732036990720:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788837777.200978:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.200988:0:6528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.200996:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788837777.201100:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:1.0:1788837777.201213:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788837777.201295:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875732036990848:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788837777.201354:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837777.201419:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837777.202383:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036990848 00000100:00100000:3.0:1788837777.202402:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036990848 00000100:00100000:0.0:1788837777.202574:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788837777.202584:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1875732036990848:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788837777.202688:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6528:x1875732036990848:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 105us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.202696:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788837777.202844:0:6528:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:1.0:1788837777.202851:0:6528:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:1.0:1788837777.202868:0:6528:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8899c36de680, transno 4294967308 00000100:00100000:1.0:1788837777.202888:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875732036990848:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788837777.203007:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1788837777.203073:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875732036990976:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788837777.203104:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837777.203122:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae554e240 going to sleep for 11 seconds 00000100:00080000:3.0:1788837777.203383:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837777.203484:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036990976 00000100:00100000:0.0:1788837777.203490:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036990976 00000100:00100000:0.0:1788837777.203525:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788837777.203533:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6528:x1875732036990976:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788837777.203651:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6528:x1875732036990976:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 118us (545us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788837777.203659:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788837777.203743:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6528:1875732036990976:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788837777.203806:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1788837777.203853:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.203864:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.203871:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.203877:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837777.203882:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.203889:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.203904:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f700) 00010000:00010000:3.0:1788837777.203907:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788837777.203912:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.203917:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aefe7c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788837777.203998:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788837777.204059:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1788837777.204070:0:6528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394075293279ns, next at 395075291205ns, rc = 0 00000001:00080000:3.0:1788837777.204076:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:3.0:1788837777.204104:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f700) 00010000:00010000:3.0:1788837777.204107:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788837777.204114:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324e00/0x57f6d4e926aefe67 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed54 expref: 55 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837777.204499:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aded56850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+54:12422:x1875732012824576:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 9840us (10094us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788837777.204508:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 56 00000020:00080000:3.0:1788837777.204512:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788837777.210691:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.210764:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012824832 00000100:00100000:1.0:1788837777.210807:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012824832 00000100:00100000:1.0:1788837777.210871:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 219 00000100:00100000:1.0:1788837777.210880:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+54:12422:x1875732012824832:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788837777.210903:0:14627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837777.210926:0:14627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefe83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed5b expref: -99 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.210984:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefe83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed5b expref: 55 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.210998:0:14627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefe83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed5b expref: 55 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.211015:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:1.0:1788837777.211019:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788837777.211034:0:14627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9000, rc 0) 00000100:00100000:1.0:1788837777.211105:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+55:12422:x1875732012824832:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 225us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837777.211112:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 219 00000100:00100000:0.0:1788837777.213874:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.213982:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012825088 00000100:00100000:1.0:1788837777.213990:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012825088 00000100:00100000:1.0:1788837777.214046:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:1.0:1788837777.214056:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+55:12422:x1875732012825088:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:1.0:1788837777.214308:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+56:12422:x1875732012825088:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 252us (443us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788837777.214316:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:2.0:1788837777.295938:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.296041:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012825216 00000100:00100000:0.0:1788837777.296052:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012825216 00000100:00100000:0.0:1788837777.296115:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 220 00000100:00100000:0.0:1788837777.296125:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+56:12432:x1875732012825216:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:0.0:1788837777.296212:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefe8a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296230:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefe8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296242:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefe8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296263:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296271:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296277:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296352:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296362:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296369:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837777.296436:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296449:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefe8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296456:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefe8a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296463:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefe8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296470:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837777.296474:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefe8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296483:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefe8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296494:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:0.0:1788837777.296497:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837777.296502:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefe8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296509:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefe8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296523:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296529:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296541:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296546:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9ba00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837777.296549:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296556:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296564:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889af8da5100) 00010000:00010000:0.0:1788837777.296567:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837777.296570:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296576:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefe91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296585:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296591:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296597:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296602:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837777.296604:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296619:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296628:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:0.0:1788837777.296630:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837777.296633:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe98 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.296639:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837777.296725:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+56:12432:x1875732012825216:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 600us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.296734:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 220 00000100:00100000:2.0:1788837777.327547:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.327649:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012825472 00000100:00100000:0.0:1788837777.327659:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012825472 00000100:00100000:0.0:1788837777.327720:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 221 00000100:00100000:0.0:1788837777.327731:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+56:12435:x1875732012825472:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837777.327751:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837777.327771:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed62 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.327894:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefea6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.327910:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefea6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.327920:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefea6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.327942:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefead lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.327950:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.327957:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328080:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefeb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328089:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefeb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328097:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefeb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837777.328107:0:9317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788837777.328192:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefea6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328200:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefea6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328211:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefea6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328218:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9ba00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837777.328222:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefea6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328253:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefea6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328269:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:0.0:1788837777.328272:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837777.328277:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefea6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328286:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefea6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328305:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefead lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328311:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefead lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328320:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefead lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328325:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837777.328328:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefead lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328337:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefead lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328343:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889af8da5100) 00010000:00010000:0.0:1788837777.328346:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837777.328349:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefead lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328367:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefead lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328407:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aefe9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed62 expref: 59 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328425:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefeb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed62 expref: 58 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.328435:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:0.0:1788837777.328438:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837777.328440:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b200, rc 0) 00000100:00100000:0.0:1788837777.328622:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+58:12435:x1875732012825472:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 891us (1083us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1788837777.328629:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 221 00000100:00100000:3.0:1788837777.332158:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.332266:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012825600 00000100:00100000:1.0:1788837777.332277:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012825600 00000100:00100000:1.0:1788837777.332338:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 222 00000100:00100000:1.0:1788837777.332348:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+58:12435:x1875732012825600:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:1.0:1788837777.332420:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefec2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.332439:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.332450:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.332485:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.332491:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefec2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.332516:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefec2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.332522:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837777.332526:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefec2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.332539:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefec2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.332551:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:1.0:1788837777.332557:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837777.332561:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefec2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.332571:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefec2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837777.332651:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+58:12435:x1875732012825600:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 304us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837777.332661:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 222 00000100:00100000:2.0:1788837777.342284:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.342374:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012825856 00000100:00100000:1.0:1788837777.342384:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012825856 00000100:00100000:1.0:1788837777.342439:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:1.0:1788837777.342450:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+58:12435:x1875732012825856:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:1.0:1788837777.342680:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+59:12435:x1875732012825856:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 230us (404us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788837777.342688:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:2.0:1788837777.433480:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.433578:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012826112 00000100:00100000:0.0:1788837777.433588:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012826112 00000100:00100000:0.0:1788837777.433649:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 223 00000100:00100000:0.0:1788837777.433659:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+59:12445:x1875732012826112:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:0.0:1788837777.433683:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837777.433686:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788837777.433713:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324a00/0x57f6d4e926aefe44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed46 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.433733:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:0.0:1788837777.433739:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837777.433769:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefec9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed69 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.433943:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.433958:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefeb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed62 expref: 59 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.433967:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.434005:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefeb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed62 expref: 59 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.434133:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefeb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed62 expref: 59 pid: 9317 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837777.434155:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036991104:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837777.434402:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24e5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837777.442997:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.443946:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012826240 00000100:00100000:1.0:1788837777.443958:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012826240 00010000:00010000:1.0:1788837777.444003:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefeb4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed62 expref: 60 pid: 9317 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837777.444051:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 98 00000100:00100000:1.0:1788837777.444061:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+60:2395:x1875732012826240:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837777.444079:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837777.444085:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefeb4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed62 expref: 60 pid: 9317 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.444098:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefeb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed62 expref: 60 pid: 9317 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.444120:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:1.0:1788837777.444125:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.444135:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.444142:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.444160:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837777.444220:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+60:2395:x1875732012826240:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 160us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837777.444228:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 98 00010000:00010000:2.0:1788837777.445762:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aefeb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed62 expref: 59 pid: 9317 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837777.445803:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036991104:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837777.445839:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.445851:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.445858:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837777.445879:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788837777.446083:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aefec9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed69 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.446102:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed69 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.446112:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:2.0:1788837777.446115:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788837777.446119:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9ba00, rc 0) 00000100:00100000:2.0:1788837777.446381:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+59:12445:x1875732012826112:12345-192.168.201.3@tcp:101:bash.0 Request processed in 12538us (12725us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788837777.446393:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 223 00000100:00100000:0.0:1788837777.448876:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.449001:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012826368 00000100:00100000:1.0:1788837777.449033:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012826368 00000100:00100000:1.0:1788837777.449128:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 224 00000100:00100000:1.0:1788837777.449139:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+59:12445:x1875732012826368:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788837777.449165:0:14627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837777.449187:0:14627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefede lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed70 expref: -99 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.449224:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefee5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.449239:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.449263:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.449377:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefede lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed70 expref: 61 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.449397:0:14627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed70 expref: 60 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.449406:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:1.0:1788837777.449409:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788837777.449413:0:14627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9200, rc 0) 00000100:00100000:1.0:1788837777.449475:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+60:12445:x1875732012826368:12345-192.168.201.3@tcp:101:bash.0 Request processed in 337us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837777.449482:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 224 00000100:00100000:2.0:1788837777.453417:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.453497:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012826624 00000100:00100000:0.0:1788837777.453507:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012826624 00000100:00100000:0.0:1788837777.453563:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 225 00000100:00100000:0.0:1788837777.453573:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+60:12445:x1875732012826624:12345-192.168.201.3@tcp:36:bash.0 00010000:00010000:0.0:1788837777.453828:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aefeec lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.453863:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aefeec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.453873:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aefeec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837777.453917:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:0.0:1788837777.453939:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfb4088a reply state 00000000f2872f7e transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aefeec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.453952:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aefeec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.453959:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:0.0:1788837777.453962:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788837777.453964:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837777.454061:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+63:12445:x1875732012826624:12345-192.168.201.3@tcp:36:bash.0 Request processed in 488us (652us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788837777.454067:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 225 00000020:00080000:0.0:1788837777.454072:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788837777.458603:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837777.458677:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012826752 00000100:00100000:2.0:1788837777.458687:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012826752 00000100:00100000:2.0:1788837777.458743:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 226 00000100:00100000:2.0:1788837777.458753:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+63:12445:x1875732012826752:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788837777.458818:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837777.458840:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefef3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed77 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.458933:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.458948:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed69 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.458957:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.458988:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed69 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.459002:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed69 expref: 64 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837777.459027:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4491880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036991232:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837777.459119:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c26296c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837777.463825:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.463939:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012826880 00000100:00100000:0.0:1788837777.463949:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012826880 00010000:00010000:0.0:1788837777.463987:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed69 expref: 65 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837777.464036:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 99 00000100:00100000:0.0:1788837777.464046:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+65:2395:x1875732012826880:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837777.464059:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837777.464077:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed69 expref: 65 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.464089:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed69 expref: 65 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.464110:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:0.0:1788837777.464115:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.464124:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.464129:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.464144:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837777.464203:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+65:2395:x1875732012826880:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 159us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.464211:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 99 00010000:00010000:2.0:1788837777.464605:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aefed0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed69 expref: 64 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837777.464622:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4491880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036991232:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837777.464642:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.464652:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.464658:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837777.464704:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788837777.464707:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788837777.464724:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.464753:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324800/0x57f6d4e926aefef3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed77 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.464767:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed77 expref: 63 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.464822:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:2.0:1788837777.464826:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837777.464828:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1325200, rc 0) 00000100:00100000:2.0:1788837777.464863:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+63:12445:x1875732012826752:12345-192.168.201.3@tcp:101:bash.0 Request processed in 6112us (6271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837777.464878:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 226 00000100:00100000:3.0:1788837777.468503:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.468593:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012827136 00000100:00100000:1.0:1788837777.468619:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012827136 00000100:00100000:1.0:1788837777.468682:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:1.0:1788837777.468692:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+63:12445:x1875732012827136:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:1.0:1788837777.468974:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+64:12445:x1875732012827136:12345-192.168.201.3@tcp:35:bash.0 Request processed in 282us (482us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788837777.468981:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:1.0:1788837777.549608:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.549706:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012827264 00000100:00100000:0.0:1788837777.549716:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012827264 00000100:00100000:0.0:1788837777.549803:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 227 00000100:00100000:0.0:1788837777.549823:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+64:12451:x1875732012827264:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837777.549847:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837777.549868:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aeff01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed7e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.549933:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aeff08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.549960:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aeff08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.549971:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aeff08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837777.550025:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788837777.550030:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788837777.550048:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aeff08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.550072:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aeff01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed7e expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.550091:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aeff08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed7e expref: 65 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.550100:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:0.0:1788837777.550102:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837777.550106:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9bc00, rc 0) 00000100:00100000:0.0:1788837777.550165:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+65:12451:x1875732012827264:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 354us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.550173:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 227 00000100:00100000:0.0:1788837777.556712:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.556806:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012827392 00000100:00100000:1.0:1788837777.556827:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012827392 00000100:00100000:1.0:1788837777.556888:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 228 00000100:00100000:1.0:1788837777.556898:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+65:12451:x1875732012827392:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788837777.556919:0:14627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837777.556940:0:14627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aeff0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed85 expref: -99 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557005:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff16 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557032:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557043:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557055:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557062:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557089:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557158:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557168:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557175:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837777.557227:0:14627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788837777.557232:0:14627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837777.557258:0:14627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557270:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557279:0:14627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557285:0:14627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff16 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557291:0:14627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557297:0:14627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837777.557300:0:14627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557315:0:14627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557328:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:1.0:1788837777.557331:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837777.557335:0:14627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557340:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557352:0:14627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557358:0:14627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557364:0:14627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557369:0:14627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837777.557372:0:14627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557378:0:14627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557385:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889af8da5100) 00010000:00010000:1.0:1788837777.557387:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837777.557390:0:14627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557407:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557434:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aeff0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed85 expref: 67 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557447:0:14627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed85 expref: 66 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.557454:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:1.0:1788837777.557456:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837777.557459:0:14627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac0030a00, rc 0) 00000100:00100000:1.0:1788837777.557525:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+66:12451:x1875732012827392:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 629us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837777.557533:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 228 00000100:00100000:3.0:1788837777.561057:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.561159:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012827648 00000100:00100000:1.0:1788837777.561169:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012827648 00000100:00100000:1.0:1788837777.561244:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:1.0:1788837777.561255:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+66:2395:x1875732012827648:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837777.561270:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837777.561295:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed85 expref: 66 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.561313:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:1.0:1788837777.561318:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837777.561375:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+65:2395:x1875732012827648:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 122us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837777.561396:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:2.0:1788837777.564465:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.564697:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012827776 00000100:00100000:0.0:1788837777.564708:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012827776 00000100:00100000:0.0:1788837777.564764:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 229 00000100:00100000:0.0:1788837777.564823:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+65:12451:x1875732012827776:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837777.564858:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837777.564887:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a000/0x57f6d4e926aeff2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed8c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.565003:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.565031:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed77 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.565042:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.565075:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed77 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.565089:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed77 expref: 66 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837777.565108:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036991360:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837777.565193:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24e5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788837777.571611:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837777.571684:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012827904 00000100:00100000:3.0:1788837777.571693:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012827904 00010000:00010000:3.0:1788837777.571737:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed77 expref: 67 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837777.571772:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 100 00000100:00100000:3.0:1788837777.571807:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8562050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+67:2395:x1875732012827904:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837777.571831:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837777.571838:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed77 expref: 67 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.571851:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed77 expref: 67 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.571872:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:2.0:1788837777.571875:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aefefa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed77 expref: 67 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837777.571891:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6524:1875732036991360:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837777.571902:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.571911:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.571931:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.572035:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.572440:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837777.572490:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837777.572499:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8562050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+66:2395:x1875732012827904:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 692us (896us total) trans 0 rc 0/0 00010000:00010000:2.0:1788837777.572499:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837777.572507:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 100 00000004:00200000:2.0:1788837777.572518:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788837777.572631:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a000/0x57f6d4e926aeff2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed8c expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.572643:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed8c expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.572648:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:2.0:1788837777.572650:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788837777.572652:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9be00, rc 0) 00000100:00100000:2.0:1788837777.572671:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+66:12451:x1875732012827776:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 7901us (8217us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788837777.572675:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 229 00000100:00100000:3.0:1788837777.577173:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.577230:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012828160 00000100:00100000:1.0:1788837777.577305:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012828160 00000100:00100000:1.0:1788837777.577419:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:1.0:1788837777.577430:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+66:12451:x1875732012828160:12345-192.168.201.3@tcp:103:lfs.0 00010000:00010000:1.0:1788837777.577449:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837777.577476:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefe83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed5b expref: 66 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.577494:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:1.0:1788837777.577499:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837777.577560:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+65:12451:x1875732012828160:12345-192.168.201.3@tcp:103:lfs.0 Request processed in 131us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837777.577567:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:1.0:1788837777.579089:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.579217:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012828288 00000100:00100000:0.0:1788837777.579234:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012828288 00000100:00100000:0.0:1788837777.579283:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 230 00000100:00100000:0.0:1788837777.579291:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+65:12451:x1875732012828288:12345-192.168.201.3@tcp:58:lfs.0 00010000:00010000:0.0:1788837777.579391:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aeff40 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.579426:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aeff40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.579437:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aeff40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837777.579529:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788837777.579603:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+65:12451:x1875732012828288:12345-192.168.201.3@tcp:58:lfs.0 Request processed in 311us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.579611:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 230 00000100:00100000:0.0:1788837777.581707:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837777.582107:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012828416 00000100:00100000:3.0:1788837777.582116:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012828416 00000100:00100000:3.0:1788837777.582218:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 231 00000100:00100000:3.0:1788837777.582229:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+65:12451:x1875732012828416:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788837777.582256:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837777.582276:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aeff47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed93 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.582328:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aeff40 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.582338:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aeff47 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed93 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.582356:0:6525:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aeff40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.582387:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aeff47 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed93 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.582400:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:3.0:1788837777.582403:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837777.582406:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aeff47 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed93 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.582414:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17800, rc 0) 00000100:00100000:3.0:1788837777.582471:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+66:12451:x1875732012828416:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 243us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837777.582477:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 231 00000040:00080000:0.0:1788837777.851570:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837777.851579:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837777.851602:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788837777.851610:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788837777.851763:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875732036991488:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788837777.852233:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24e5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837777.856226:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837777.856364:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012828544 00000100:00100000:2.0:1788837777.856374:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012828544 00000100:00100000:2.0:1788837777.856433:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 232 00000100:00100000:2.0:1788837777.856443:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+67:12452:x1875732012828544:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788837777.856472:0:6524:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788837777.856669:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875732036991488:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788837777.857958:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+66:12452:x1875732012828544:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 1509us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837777.857970:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 232 00000100:00100000:3.0:1788837777.864079:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.864447:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012828672 00000100:00100000:1.0:1788837777.864458:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012828672 00000100:00100000:1.0:1788837777.864523:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 233 00000100:00100000:1.0:1788837777.864534:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+66:12452:x1875732012828672:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788837777.864611:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aeff4e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864629:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aeff4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864660:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aeff4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864678:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aeff55 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864686:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aeff55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864692:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aeff55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864715:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864724:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864730:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837777.864821:0:14627:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788837777.864825:0:14627:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837777.864838:0:14627:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864849:0:14627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aeff4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864856:0:14627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aeff4e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864873:0:14627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aeff4e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864879:0:14627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0030e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837777.864884:0:14627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aeff4e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864892:0:14627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aeff4e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864905:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aded2c400) 00010000:00010000:1.0:1788837777.864908:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837777.864912:0:14627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aeff4e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864918:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030e00/0x57f6d4e926aeff4e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864933:0:14627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aeff55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864939:0:14627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aeff55 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864945:0:14627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aeff55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864950:0:14627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0031800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837777.864953:0:14627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aeff55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864969:0:14627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aeff55 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864976:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff889b01a1f200) 00010000:00010000:1.0:1788837777.864979:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837777.864982:0:14627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aeff55 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.864986:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031800/0x57f6d4e926aeff55 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.865002:0:14627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.865008:0:14627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.865137:0:14627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.865142:0:14627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0030a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837777.865145:0:14627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.865151:0:14627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.865161:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:1.0:1788837777.865163:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837777.865166:0:14627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff5c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.865180:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0030a00/0x57f6d4e926aeff5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837777.871350:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+66:12452:x1875732012828672:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 Request processed in 6806us (7268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.871366:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 233 00000100:00100000:3.0:1788837777.876047:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.879337:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012828928 00000100:00100000:1.0:1788837777.879352:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012828928 00000100:00100000:1.0:1788837777.879427:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 234 00000100:00100000:1.0:1788837777.879438:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+66:12452:x1875732012828928:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837777.879460:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837777.879479:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aeff63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ed9a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.879568:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.879580:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.879588:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837777.879596:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788837777.879656:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.879661:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.879666:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.879684:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837777.879687:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.879692:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.879701:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:1.0:1788837777.879703:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788837777.879706:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.879710:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.879741:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aeff63 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed9a expref: 68 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.879747:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aded2c400) 00010000:00010000:1.0:1788837777.879749:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837777.879751:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aeff63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed9a expref: 68 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.879757:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8c00, rc 0) 00000100:00100000:1.0:1788837777.879876:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+67:12452:x1875732012828928:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 439us (3839us total) trans 4294967506 rc 301/301 00000100:00100000:1.0:1788837777.879884:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 234 00000100:00100000:1.0:1788837777.886465:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837777.886568:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012829056 00000100:00100000:2.0:1788837777.886578:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012829056 00000100:00100000:2.0:1788837777.886640:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 235 00000100:00100000:2.0:1788837777.886651:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+67:12452:x1875732012829056:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788837777.886683:0:6524:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788837777.886833:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+67:12452:x1875732012829056:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 183us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837777.886842:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 235 00000100:00100000:0.0:1788837777.890701:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837777.890820:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012829312 00000100:00100000:2.0:1788837777.890830:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012829312 00000100:00100000:2.0:1788837777.890885:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 236 00000100:00100000:2.0:1788837777.890895:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+67:12452:x1875732012829312:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837777.890914:0:14627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837777.890918:0:14627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788837777.890947:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9bc00/0x57f6d4e926aeff08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed7e expref: 67 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.890967:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:2.0:1788837777.890988:0:14627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837777.891005:0:14627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aeff78 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eda1 expref: -99 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837777.891340:0:14627:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788837777.891459:0:14627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aeff7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.891471:0:14627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aeff7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.891480:0:14627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aeff7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.891519:0:14627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325200/0x57f6d4e926aeff78 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eda1 expref: 69 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.891533:0:14627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aeff7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eda1 expref: 68 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.891540:0:14627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889aded28800) 00010000:00010000:2.0:1788837777.891543:0:14627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837777.891545:0:14627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1325e00, rc 0) 00000100:00100000:2.0:1788837777.891603:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+68:12452:x1875732012829312:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 710us (913us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788837777.891610:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 236 00000100:00100000:3.0:1788837777.896234:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.896324:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012829568 00000100:00100000:1.0:1788837777.896335:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012829568 00000100:00100000:1.0:1788837777.896394:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 237 00000100:00100000:1.0:1788837777.896404:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+68:12452:x1875732012829568:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788837777.896464:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837777.896489:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325e00/0x57f6d4e926aeff7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eda1 expref: 68 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896508:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889aded28800) 00010000:00010000:1.0:1788837777.896518:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837777.896539:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896553:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896564:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896632:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xd86afbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896641:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd86afbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896648:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd86afbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896690:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896715:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff8d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896722:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896728:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837777.896733:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896740:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896749:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:1.0:1788837777.896752:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837777.896756:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff8d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896761:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeff8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896772:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd86afbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896836:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff94 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd86afbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896842:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff94 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd86afbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896847:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837777.896857:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff94 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd86afbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896863:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff94 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd86afbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896871:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xd86afbf (ffff889b01a1f200) 00010000:00010000:1.0:1788837777.896873:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837777.896876:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff94 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd86afbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.896881:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeff94 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd86afbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837777.896969:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+67:12452:x1875732012829568:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 565us (745us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788837777.896975:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 237 00000100:00100000:1.0:1788837777.908930:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.909064:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012829696 00000100:00100000:0.0:1788837777.909074:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012829696 00000100:00100000:0.0:1788837777.909141:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 238 00000100:00100000:0.0:1788837777.909152:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af8df7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+67:12452:x1875732012829696:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837777.909171:0:9317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837777.909204:0:9317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aeff9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eda8 expref: -99 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.909241:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aeffa2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.909256:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aeffa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.909268:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aeffa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.909366:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aeff9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eda8 expref: 69 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.909384:0:9317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aeffa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eda8 expref: 68 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.909394:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889af8da5800) 00010000:00010000:0.0:1788837777.909397:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788837777.909401:0:9317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b400, rc 0) 00000100:00100000:0.0:1788837777.910047:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af8df7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+68:12452:x1875732012829696:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 893us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.910055:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 238 00000100:00100000:3.0:1788837777.929508:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.930152:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012829952 00000100:00100000:0.0:1788837777.930164:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012829952 00000100:00100000:0.0:1788837777.930231:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 239 00000100:00100000:0.0:1788837777.930241:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+68:12452:x1875732012829952:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837777.930324:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aeffa9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.930356:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aeffa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.930368:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aeffa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837777.930519:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1788837777.930567:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a28f65a reply state 000000006bb2fe77 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aeffa9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.930580:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aeffa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.930587:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889af8da5800) 00010000:00010000:0.0:1788837777.930591:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788837777.930594:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837777.930697:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+70:12452:x1875732012829952:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 456us (1199us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1788837777.930706:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 239 00000100:00100000:2.0:1788837777.935082:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.935182:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012830080 00000100:00100000:0.0:1788837777.935193:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012830080 00000100:00100000:0.0:1788837777.935253:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 240 00000100:00100000:0.0:1788837777.935264:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+70:12452:x1875732012830080:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837777.935285:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837777.935307:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aeffb0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003edaf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.935365:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aeffb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edaf expref: 71 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.935396:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aeffb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edaf expref: 71 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837777.935415:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889af8da5800) 00010000:00010000:0.0:1788837777.935418:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837777.935422:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b200, rc 0) 00000100:00100000:0.0:1788837777.935482:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+71:12452:x1875732012830080:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 218us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.935489:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 240 00000100:00100000:2.0:1788837777.938090:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837777.938168:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012830208 00000100:00100000:3.0:1788837777.938177:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012830208 00000100:00100000:3.0:1788837777.938231:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 70 00000100:00100000:3.0:1788837777.938250:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+9:2396:x1875732012830208:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788837777.938448:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+10:2396:x1875732012830208:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 198us (367us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788837777.938457:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 70 00000100:00100000:3.0:1788837777.940580:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.940688:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012830464 00000100:00100000:1.0:1788837777.940696:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012830464 00000100:00100000:1.0:1788837777.940746:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:1.0:1788837777.940756:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+71:12452:x1875732012830464:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788837777.941002:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+72:12452:x1875732012830464:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 247us (430us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788837777.941019:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:2.0:1788837777.947382:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.950838:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012830720 00000100:00100000:0.0:1788837777.950855:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012830720 00000100:00100000:0.0:1788837777.950939:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 241 00000100:00100000:0.0:1788837777.950950:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+72:12452:x1875732012830720:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788837777.951084:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+72:12452:x1875732012830720:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 134us (3711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.951092:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 241 00000100:00100000:2.0:1788837777.959437:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.959534:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012830848 00000100:00100000:1.0:1788837777.959544:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012830848 00000100:00100000:1.0:1788837777.959609:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 242 00000100:00100000:1.0:1788837777.959620:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+72:12452:x1875732012830848:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837777.959653:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837777.959672:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeffb7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003edb6 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.959741:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeffbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.959756:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeffbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.959767:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeffbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837777.959856:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837777.959876:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeffbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.959903:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926aeffb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edb6 expref: 74 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.959921:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeffbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edb6 expref: 73 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.959930:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889af8da5800) 00010000:00010000:1.0:1788837777.959933:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788837777.959936:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9a00, rc 0) 00000100:00100000:1.0:1788837777.959987:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+73:12452:x1875732012830848:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 369us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837777.959995:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 242 00000100:00100000:3.0:1788837777.962530:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837777.962602:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012830976 00000100:00100000:1.0:1788837777.962610:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012830976 00000100:00100000:1.0:1788837777.962659:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 71 00000100:00100000:1.0:1788837777.962669:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3a879e24-3b2f-4404-84c2-9101689d9315+10:2396:x1875732012830976:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788837777.962685:0:14078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837777.962703:0:14078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926aeffc5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003edbd expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788837777.962725:0:14078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7f92, blocks: 0x0 00010000:00010000:1.0:1788837777.962743:0:14078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=394s v=(0 0) 00010000:00010000:1.0:1788837777.962748:0:14078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837777.962758:0:14078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926aeffc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edbd expref: 11 pid: 14078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.962799:0:14078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926aeffc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edbd expref: 11 pid: 14078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837777.962823:0:14078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8c00, rc 0) 00000100:00100000:1.0:1788837777.962876:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3a879e24-3b2f-4404-84c2-9101689d9315+11:2396:x1875732012830976:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 208us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837777.962883:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 71 00000100:00100000:2.0:1788837777.969212:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.969321:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012831232 00000100:00100000:0.0:1788837777.969331:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012831232 00000100:00100000:0.0:1788837777.969395:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 243 00000100:00100000:0.0:1788837777.969405:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+73:12452:x1875732012831232:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788837777.969521:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+73:12452:x1875732012831232:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 117us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.969529:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 243 00000100:00100000:2.0:1788837777.973971:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837777.974109:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012831360 00000100:00100000:3.0:1788837777.974119:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012831360 00000100:00100000:3.0:1788837777.974177:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:3.0:1788837777.974187:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+11:12452:x1875732012831360:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837777.974205:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837777.974222:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aeffcc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003edc4 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.974265:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926aeffc5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edbd expref: 12 pid: 14078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.974275:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837777.974279:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837777.974284:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aeffcc lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edc4 expref: 12 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.974318:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926aeffc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003edbd expref: 12 pid: 14078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.974332:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926aeffc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003edbd expref: 12 pid: 14078 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837777.974346:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1875732036991616:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788837777.974452:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac52309c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837777.977229:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d42a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1875732036991616:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837777.977266:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aeffcc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003edc4 expref: 12 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837777.977304:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16800, rc 0) 00000100:00100000:3.0:1788837777.977373:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+12:12452:x1875732012831360:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 3187us (3410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837777.977382:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:1.0:1788837777.978741:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.982111:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012831488 00000100:00100000:0.0:1788837777.982147:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012831488 00010000:00010000:2.0:1788837777.987073:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926aeffc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003edbd expref: 12 pid: 14078 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837777.987132:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 101 00000100:00100000:2.0:1788837777.987144:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+12:2395:x1875732012831488:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837777.987160:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837777.987182:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926aeffc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003edbd expref: 12 pid: 14078 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.987196:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926aeffc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003edbd expref: 12 pid: 14078 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.987220:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926aeffc5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003edbd expref: 12 pid: 14078 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.987249:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837777.987254:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837777.987262:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aeffcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003edc4 expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.987273:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aeffcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003edc4 expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837777.987332:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aeffcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003edc4 expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837777.987346:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6509:1875732036991744:192.168.201.3@tcp:105: 00000100:00100000:2.0:1788837777.987990:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2629e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837777.993038:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837777.994024:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012831616 00000100:00100000:0.0:1788837777.994036:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012831616 00002000:00100000:0.0:1788837777.994092:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8899c4493480 x1875732012831616/t0(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:433/0 lens 504/0 e 0 to 0 dl 1788837788 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788837777.994103:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c4493480 with x1875732012831616 ext(0->12) 00002000:00010000:0.0:1788837777.994108:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8899c4493480 00000100:00100000:0.0:1788837777.994143:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:0.0:1788837777.994152:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3a879e24-3b2f-4404-84c2-9101689d9315+12:2395:x1875732012831616:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788837777.995709:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3a879e24-3b2f-4404-84c2-9101689d9315+14:2395:x1875732012831616:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 Request processed in 1549us (2672us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788837777.995730:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00002000:00100000:0.0:1788837777.995739:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8899c4493480 x1875732012831616/t4294967321(0) o4->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:433/0 lens 504/448 e 0 to 0 dl 1788837788 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788837777.995749:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c4493480 with x1875732012831616 ext(0->12) 00002000:00010000:0.0:1788837777.995755:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8899c4493480 00000100:00100000:3.0:1788837777.996645:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6509:1875732036991744:192.168.201.3@tcp:105: 00010000:00010000:3.0:1788837777.996671:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837777.996871:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3a879e24-3b2f-4404-84c2-9101689d9315+13:2395:x1875732012831488:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 9729us (18135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837777.996880:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 101 00000100:00100000:1.0:1788837778.000863:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837778.001026:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012831744 00000100:00100000:0.0:1788837778.001037:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012831744 00000100:00100000:0.0:1788837778.001113:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 244 00000100:00100000:0.0:1788837778.001123:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+73:12452:x1875732012831744:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 00000100:00080000:3.0:1788837778.001230:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1788837778.005664:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:1.0:1788837778.005704:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1788837778.005726:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff889af9971840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788837778.005731:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889afa679d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff889af9971d80 00000020:00080000:1.0:1788837778.005748:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889afa679500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff889ad9ac5800 00000004:00080000:1.0:1788837778.005816:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788837778.005847:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff889ae554e0c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788837778.005850:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889af8e48200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff889ae554e6c0 00000020:00080000:1.0:1788837778.005853:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889aded97d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff889ad115b000 00000020:00080000:1.0:1788837778.005862:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1788837778.005913:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036991872:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1788837778.005928:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788837778.005978:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788837778.005978:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837778.006026:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837778.006032:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036992000:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788837778.006055:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837778.006099:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036991872 00000100:00100000:3.0:1788837778.006106:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036991872 00000100:00100000:3.0:1788837778.006159:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036992000 00000100:00100000:3.0:1788837778.006162:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036992000 00000100:00100000:3.0:1788837778.006194:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00010000:00010000:0.0:1788837778.006253:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefcd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006274:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefcd1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006282:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefcd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006288:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837778.006292:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefcd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006300:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefcd1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006316:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff889b01a1fb00) 00010000:00010000:0.0:1788837778.006318:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837778.006323:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefcd1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006330:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17c00/0x57f6d4e926aefcd1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14627 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006356:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefd79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006362:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefd79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006367:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefd79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006372:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837778.006380:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefd79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006386:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefd79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006394:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889afa694a00) 00010000:00010000:0.0:1788837778.006397:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837778.006400:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefd79 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006405:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16600/0x57f6d4e926aefd79 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006420:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdf7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006426:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdf7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006432:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdf7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006436:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837778.006439:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdf7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006445:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdf7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006453:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889af8da5100) 00010000:00010000:0.0:1788837778.006455:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837778.006463:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdf7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006469:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926aefdf7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006482:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefe1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006489:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefe1a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006495:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefe1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006499:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837778.006502:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefe1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006508:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefe1a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006515:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889af8da5100) 00010000:00010000:0.0:1788837778.006518:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837778.006520:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefe1a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006526:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926aefe1a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006541:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aefeec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006555:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aefeec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006562:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aefeec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006567:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837778.006570:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aefeec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006576:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aefeec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006584:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:0.0:1788837778.006586:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837778.006589:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aefeec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006594:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926aefeec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006618:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aeffa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006625:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aeffa9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006631:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aeffa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006636:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9ba00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837778.006643:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aeffa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006650:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aeffa9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006658:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889af8da5800) 00010000:00010000:0.0:1788837778.006660:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788837778.006663:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aeffa9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.006669:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926aeffa9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837778.006817:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+21:12452:x1875732012831744:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 Request processed in 5651us (5919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837778.006828:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 244 00000100:00100000:3.0:1788837778.006964:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036991872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788837778.006990:0:8544:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1788837778.007018:0:8544:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f7f91, atime: 0x6a9f7f91, ctime: 0x6a9f7f91, blocks: 0x8 00010000:00010000:3.0:1788837778.007024:0:8544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aec91a5a/0x57f6d4e926aeffd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.007038:0:8544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1788837778.007042:0:8544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837778.007048:0:8544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aec91a5a/0x57f6d4e926aeffd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.007060:0:8544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aec91a5a/0x57f6d4e926aeffd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.007075:0:8544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aec91a5a/0x57f6d4e926aeffd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.007083:0:8544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aec91a5a/0x57f6d4e926aeffd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.007106:0:8544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788837778.007219:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3650:x1875732036991872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 261us (1241us total) trans 4294967311 rc 0/0 00010000:00010000:0.0:1788837778.007264:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837778.007270:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aec91a5a/0x57f6d4e926aeffd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.007278:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837778.007281:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aec91a5a/0x57f6d4e926aeffd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.007289:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aec91a5a/0x57f6d4e926aeffd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.007302:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aec91a5a/0x57f6d4e926aeffd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.007315:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aec91a5a/0x57f6d4e926aeffd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.007331:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837778.007333:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837778.007335:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837778.008651:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788837778.008670:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732036992000:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788837778.008686:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788837778.008828:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788837778.008872:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8899c4490e00/2, rc 0, transno 4294967311 00002000:00080000:2.0:1788837778.009649:0:14078:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1788837778.009676:0:14078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aeffda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.009697:0:14078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926aefd87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed1c expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.009705:0:14078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788837778.009709:0:14078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837778.009713:0:14078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aeffda lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.009787:0:14078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926aefd87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed1c expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.009813:0:14078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926aefd87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed1c expref: 12 pid: 8440 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837778.009829:0:14078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14078:1875732036992128:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837778.010102:0:14078:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2629600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837778.012095:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837778.012218:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012831872 00000100:00100000:3.0:1788837778.012226:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012831872 00000100:00100000:3.0:1788837778.012301:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 75 00000100:00100000:3.0:1788837778.012310:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+13:2396:x1875732012831872:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 00000100:00080000:1.0:1788837778.012453:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837778.013297:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837778.013608:0:14078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14078:1875732036992128:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837778.013634:0:14078:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aeffda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837778.014484:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036991872:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788837778.014555:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012832000 00000100:00100000:1.0:1788837778.014562:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012832000 00010000:00010000:1.0:1788837778.014597:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926aefd87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed1c expref: 14 pid: 8440 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837778.014666:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 102 00000100:00100000:1.0:1788837778.014675:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+14:2395:x1875732012832000:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837778.014691:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837778.014698:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926aefd87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed1c expref: 14 pid: 8440 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.014711:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926aefd87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed1c expref: 14 pid: 8440 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.015044:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b28e0f91/0x57f6d4e926aefd87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed1c expref: 14 pid: 8440 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.015075:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837778.015080:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837778.015086:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aeffda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.015095:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aeffda lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.015581:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837778.015653:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+13:2395:x1875732012832000:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 976us (2356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837778.015661:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 102 00010000:00010000:2.0:1788837778.018924:0:14078:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aeffda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.018944:0:14078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aeffda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.018956:0:14078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aeffda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.018965:0:14078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aeffda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.019021:0:14078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788837778.019226:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3650:x1875732036992000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10561us (13166us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788837778.019247:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:2.0:1788837778.019287:0:10392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837778.019293:0:10392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aeffda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.019302:0:10392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837778.019306:0:10392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aeffda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.019316:0:10392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aeffda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.019336:0:10392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aeffda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.019344:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007186788c/0x57f6d4e926aeffda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.019364:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837778.019366:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837778.019367:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788837778.019404:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8899c4492a00/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788837778.019416:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036992000:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788837778.019961:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1788837778.019978:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:2.0:1788837778.020415:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:2396:x1875732012831872:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 Request processed in 8102us (8325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837778.020424:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 75 00000100:00100000:3.0:1788837778.022970:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837778.023088:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012832256 00000100:00100000:0.0:1788837778.023098:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012832256 00000100:00100000:0.0:1788837778.023154:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 245 00000100:00100000:0.0:1788837778.023164:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+21:12452:x1875732012832256:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837778.023224:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837778.023256:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926aeffbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edb6 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.023275:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889af8da5800) 00010000:00010000:0.0:1788837778.023280:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837778.023308:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aeffe1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.023322:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aeffe1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.023331:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aeffe1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837778.023454:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf92e97d reply state 000000005ae7b0d6 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aeffe1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.023468:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aeffe1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.023474:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889af8da5800) 00010000:00010000:0.0:1788837778.023477:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788837778.023480:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837778.023569:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+22:12452:x1875732012832256:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 406us (606us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1788837778.023577:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 245 00000100:00100000:0.0:1788837778.026038:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837778.026111:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012832384 00000100:00100000:2.0:1788837778.026122:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012832384 00000100:00100000:2.0:1788837778.026183:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 76 00000100:00100000:2.0:1788837778.026192:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+7:2393:x1875732012832384:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788837778.026346:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788837778.026350:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788837777 00002000:00010000:2.0:1788837778.026353:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788837777 00002000:00010000:2.0:1788837778.026355:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788837778 -> 1788837777 00002000:00010000:2.0:1788837778.026357:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788837778.026415:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+8:2393:x1875732012832384:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 223us (386us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788837778.026423:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 76 00000100:00100000:3.0:1788837778.028663:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837778.028747:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012832640 00000100:00100000:0.0:1788837778.028755:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012832640 00000100:00100000:0.0:1788837778.028848:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 246 00000100:00100000:0.0:1788837778.028859:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+22:12452:x1875732012832640:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788837778.028937:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.028954:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aeffa2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eda8 expref: 22 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.028963:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.028996:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aeffa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eda8 expref: 22 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.029042:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aeffa2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eda8 expref: 22 pid: 9317 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837778.029058:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875732036992256:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837778.029205:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24e5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837778.031822:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837778.031919:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012832768 00000100:00100000:2.0:1788837778.031929:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012832768 00010000:00010000:2.0:1788837778.031967:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aeffa2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eda8 expref: 23 pid: 9317 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837778.031999:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 103 00000100:00100000:2.0:1788837778.032016:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+23:2396:x1875732012832768:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837778.032030:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837778.032038:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aeffa2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eda8 expref: 23 pid: 9317 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.032072:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aeffa2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eda8 expref: 23 pid: 9317 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.032094:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889af8da5800) 00010000:00010000:2.0:1788837778.032100:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.032110:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.032119:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.032136:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837778.032180:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+23:2396:x1875732012832768:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 165us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837778.032188:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 103 00010000:00010000:0.0:1788837778.032345:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b400/0x57f6d4e926aeffa2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eda8 expref: 22 pid: 9317 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837778.032363:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875732036992256:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837778.032383:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.032393:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.032400:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.032436:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.032445:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.032451:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.032458:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837778.032469:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.032477:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.032487:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889af8da5800) 00010000:00010000:0.0:1788837778.032490:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788837778.032494:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.032501:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926aeffe8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837778.032550:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+21:12452:x1875732012832640:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 Request processed in 3693us (3894us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788837778.032559:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 246 00000100:00100000:3.0:1788837778.042910:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837778.042995:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012832896 00000100:00100000:0.0:1788837778.043005:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012832896 00000100:00100000:0.0:1788837778.043071:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 77 00000100:00100000:0.0:1788837778.043081:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+8:2394:x1875732012832896:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788837778.043126:0:8544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a2169d6e/0x57f6d4e926aeffef lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.043147:0:8544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aeffcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003edc4 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.043157:0:8544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837778.043161:0:8544:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788837778.043177:0:8544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2169d6e/0x57f6d4e926aeffef lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.043211:0:8544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aeffcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x857683b40003edc4 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.043226:0:8544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aeffcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003edc4 expref: 8 pid: 8439 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837778.043252:0:8544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8544:1875732036992384:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837778.043335:0:8544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24e5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837778.047259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837778.047347:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012833024 00000100:00100000:1.0:1788837778.047357:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012833024 00010000:00010000:1.0:1788837778.047394:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aeffcc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003edc4 expref: 9 pid: 8439 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837778.047439:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 104 00000100:00100000:1.0:1788837778.047450:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+9:2395:x1875732012833024:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837778.047467:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837778.047489:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aeffcc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003edc4 expref: 9 pid: 8439 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.047503:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aeffcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003edc4 expref: 9 pid: 8439 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.047550:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837778.047555:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837778.047562:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2169d6e/0x57f6d4e926aeffef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.047573:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2169d6e/0x57f6d4e926aeffef lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.047593:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837778.047653:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+9:2395:x1875732012833024:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 204us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837778.047662:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 104 00010000:00010000:0.0:1788837778.049041:0:8544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6c0fb46/0x57f6d4e926aeffcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003edc4 expref: 8 pid: 8439 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837778.049064:0:8544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8544:1875732036992384:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837778.049088:0:8544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2169d6e/0x57f6d4e926aeffef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.049100:0:8544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2169d6e/0x57f6d4e926aeffef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.049108:0:8544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2169d6e/0x57f6d4e926aeffef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.049133:0:8544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a2169d6e/0x57f6d4e926aeffef lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.049162:0:8544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2169d6e/0x57f6d4e926aeffef lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.049171:0:8544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2169d6e/0x57f6d4e926aeffef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.049179:0:8544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837778.049183:0:8544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2169d6e/0x57f6d4e926aeffef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.049193:0:8544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2169d6e/0x57f6d4e926aeffef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.049221:0:8544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2169d6e/0x57f6d4e926aeffef lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.049230:0:8544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2169d6e/0x57f6d4e926aeffef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837778.049518:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:2394:x1875732012832896:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 Request processed in 6437us (6617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837778.049529:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 77 00000100:00100000:3.0:1788837778.053069:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837778.053168:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012833280 00000100:00100000:1.0:1788837778.053179:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012833280 00000100:00100000:1.0:1788837778.053243:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 247 00000100:00100000:1.0:1788837778.053254:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+21:12452:x1875732012833280:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788837778.053330:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.053349:0:9317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefee5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed70 expref: 21 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.053359:0:9317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.053393:0:9317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed70 expref: 21 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.053420:0:9317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefee5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed70 expref: 21 pid: 14627 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837778.053434:0:9317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036992512:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788837778.053513:0:9317:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4dc9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837778.060132:0:9317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036992512:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788837778.060162:0:9317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837778.063681:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837778.064259:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012833408 00000100:00100000:2.0:1788837778.064270:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012833408 00010000:00010000:2.0:1788837778.064309:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefee5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed70 expref: 22 pid: 14627 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837778.064353:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 105 00000100:00100000:2.0:1788837778.064364:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+22:2393:x1875732012833408:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837778.064380:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837778.064387:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefee5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed70 expref: 22 pid: 14627 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.064420:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed70 expref: 22 pid: 14627 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.064444:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926aefee5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed70 expref: 22 pid: 14627 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.064463:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:2.0:1788837778.064469:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aeff47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed93 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.064479:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.064487:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.064495:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.064527:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837778.064594:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+21:2393:x1875732012833408:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 232us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837778.064603:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 105 00010000:00010000:1.0:1788837778.065177:0:9317:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.065188:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.065362:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.065376:0:9317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aeffb0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edaf expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.065384:0:9317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.065412:0:9317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aeffb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003edaf expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.065427:0:9317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aeffb0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003edaf expref: 21 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837778.065451:0:9317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036992640:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788837778.065526:0:9317:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4dc9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837778.077141:0:9317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036992640:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837778.077176:0:9317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837778.080636:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837778.081276:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012833536 00000100:00100000:1.0:1788837778.081288:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012833536 00010000:00010000:1.0:1788837778.081330:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aeffb0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003edaf expref: 22 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837778.081375:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 106 00000100:00100000:1.0:1788837778.081385:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8561050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+22:2396:x1875732012833536:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837778.081399:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837778.081406:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aeffb0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003edaf expref: 22 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.081419:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aeffb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003edaf expref: 22 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.081440:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b200/0x57f6d4e926aeffb0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003edaf expref: 22 pid: 6524 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.081458:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889af8da5800) 00010000:00010000:1.0:1788837778.081463:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.081473:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.081499:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.081664:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837778.081733:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8561050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a879e24-3b2f-4404-84c2-9101689d9315+21:2396:x1875732012833536:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 348us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837778.081741:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 106 00010000:00010000:0.0:1788837778.085321:0:9317:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.085339:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788837778.089110:0:9317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1788837778.090164:0:9317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:1.0:1788837778.090215:0:9317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1788837778.090314:0:9317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9317:1875732036992768:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788837778.090382:0:9317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837778.090419:0:9317:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837778.091027:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036992768 00000100:00100000:2.0:1788837778.091036:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036992768 00000100:00100000:2.0:1788837778.091098:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788837778.091108:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9317:x1875732036992768:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788837778.091217:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9317:x1875732036992768:12345-0@lo:1000:mdt00_003.0 Request processed in 110us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837778.091226:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788837778.092394:0:9317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:1.0:1788837778.092403:0:9317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:1.0:1788837778.092427:0:9317:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8899c4492a00 x1875732036992000/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788837794 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837778.092441:0:9317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9317:1875732036992768:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788837778.092581:0:9317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:1.0:1788837778.092651:0:9317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9317:1875732036992896:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788837778.092704:0:9317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837778.092741:0:9317:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837778.093336:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036992896 00000100:00100000:2.0:1788837778.093343:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036992896 00000100:00100000:2.0:1788837778.093398:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788837778.093408:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9317:x1875732036992896:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788837778.093547:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9317:x1875732036992896:12345-0@lo:1000:mdt00_003.0 Request processed in 140us (842us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788837778.093556:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788837778.093648:0:9317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9317:1875732036992896:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788837778.093704:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093714:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093733:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093740:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8c00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837778.093745:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093753:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093769:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889af8da5800) 00010000:00010000:3.0:1788837778.093772:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837778.093820:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093826:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926aefffd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093850:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aeff40 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093856:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aeff40 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093862:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aeff40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093887:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837778.093891:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aeff40 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093897:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aeff40 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093906:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:3.0:1788837778.093908:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837778.093915:0:9317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aeff47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed93 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093926:0:9317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aeff47 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed93 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093935:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aeff47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed93 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837778.093963:0:9317:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aeff47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed93 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837778.093974:0:9317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d41880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036993024:192.168.201.3@tcp:105: 00000100:00100000:3.0:1788837778.094050:0:9317:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5230540 going to sleep for 11 seconds 00000100:00100000:3.0:1788837778.100349:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837778.100571:0:9317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d41880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9317:1875732036993024:192.168.201.3@tcp:105: 00010000:00010000:1.0:1788837778.100600:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aeff40 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100611:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a600/0x57f6d4e926aeff40 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100662:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0004 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100676:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0004 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100687:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0004 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100696:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0004 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100703:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0004 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100710:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0004 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100728:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837778.100732:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0004 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100740:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0004 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100751:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:1.0:1788837778.100754:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837778.100758:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0004 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100763:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9a00/0x57f6d4e926af0004 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100828:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100835:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100841:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100846:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837778.100850:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100856:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.100864:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:1.0:1788837778.100867:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788837778.100870:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.101072:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9000/0x57f6d4e926aefff6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837778.101232:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+24:12452:x1875732012833280:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 47979us (48172us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788837778.101242:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 247 00000020:00080000:1.0:1788837778.101249:0:9317:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788837778.101388:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012833664 00000100:00100000:2.0:1788837778.101396:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012833664 00000100:00100000:2.0:1788837778.101441:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:2.0:1788837778.101451:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+24:12451:x1875732012833664:12345-192.168.201.3@tcp:49:lfs.0 00000100:00100000:2.0:1788837778.101539:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+24:12451:x1875732012833664:12345-192.168.201.3@tcp:49:lfs.0 Request processed in 90us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837778.101547:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 61 00000040:00080000:0.0:1788837778.103270:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837778.103278:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837778.103841:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788837778.103851:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788837778.106014:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837778.110653:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837778.110705:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837778.111267:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012833920 00000100:00100000:0.0:1788837778.111280:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012833920 00000100:00100000:0.0:1788837778.111346:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 248 00000100:00100000:0.0:1788837778.111356:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+24:12451:x1875732012833920:12345-192.168.201.3@tcp:58:lfs.0 00000040:00080000:0.0:1788837778.111525:0:14627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788837778.111603:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+24:12451:x1875732012833920:12345-192.168.201.3@tcp:58:lfs.0 Request processed in 248us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837778.111611:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 248 00000100:00100000:1.0:1788837778.118755:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012834176 00000100:00100000:1.0:1788837778.118818:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012834176 00000100:00100000:1.0:1788837778.118948:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:1.0:1788837778.118959:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aded54c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+24:12452:x1875732012834176:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788837778.119241:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788837778.119272:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:1.0:1788837778.119306:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af000b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.119322:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af000b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.119334:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af000b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.119343:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af000b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.119350:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af000b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.119355:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af000b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.119378:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788837778.119487:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aded54c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+26:12452:x1875732012834176:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 530us (8781us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788837778.119495:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 62 00000020:00080000:1.0:1788837778.119501:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788837778.119592:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837778.119602:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af000b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.119611:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837778.119615:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af000b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.119623:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af000b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.119645:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889af8da5800) 00010000:00010000:0.0:1788837778.119648:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788837778.119653:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af000b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.119659:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8800/0x57f6d4e926af000b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.119671:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837778.119673:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837778.119674:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837778.144112:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837778.144244:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012834304 00000100:00100000:0.0:1788837778.144256:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012834304 00000100:00100000:0.0:1788837778.144317:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 249 00000100:00100000:0.0:1788837778.144327:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+26:12454:x1875732012834304:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837778.144352:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837778.144372:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926af0012 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003edcb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.144435:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926af0019 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.144449:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926af0019 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.144462:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926af0019 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.144477:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af0020 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.144491:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af0020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.144499:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af0020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.144577:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0027 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.144588:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed8c expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.144597:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0027 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.144630:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed8c expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837778.144645:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed8c expref: 27 pid: 6524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837778.144660:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875732036993152:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837778.144752:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c24e5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837778.148211:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837778.148851:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6526:1875732036993152:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837778.148943:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0027 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837778.149008:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012834560 00000100:00100000:2.0:1788837778.149016:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012834560 00000100:00100000:2.0:1788837778.149078:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:2.0:1788837778.149087:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+28:6165:x1875732012834560:12345-192.168.201.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788837778.149312:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+29:6165:x1875732012834560:12345-192.168.201.3@tcp:35:ldlm_bl.0 Request processed in 224us (1121us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788837778.149320:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:3.0:1788837778.151466:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837778.151569:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012834688 00000100:00100000:2.0:1788837778.151592:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012834688 00010000:00010000:2.0:1788837778.151629:0:9528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed8c expref: 29 pid: 6524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837778.151670:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 107 00000100:00100000:2.0:1788837778.151680:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+29:2396:x1875732012834688:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837778.151696:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837778.151702:0:9528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed8c expref: 29 pid: 6524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.151715:0:9528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed8c expref: 29 pid: 6524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.151739:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9be00/0x57f6d4e926aeff32 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ed8c expref: 29 pid: 6524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.151756:0:9528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:2.0:1788837778.151760:0:9528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0027 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.151770:0:9528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.151833:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0027 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837778.151870:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837778.151984:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a879e24-3b2f-4404-84c2-9101689d9315+28:2396:x1875732012834688:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 304us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837778.152002:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 107 00010000:00010000:1.0:1788837778.152328:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152348:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837778.152398:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788837778.152403:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837778.152423:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152437:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152447:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926af0019 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152453:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926af0019 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152459:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926af0019 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152465:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837778.152477:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926af0019 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152485:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926af0019 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152495:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:1.0:1788837778.152498:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837778.152503:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926af0019 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152520:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a200/0x57f6d4e926af0019 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152535:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af0020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152541:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af0020 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152546:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af0020 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152551:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:1.0:1788837778.152554:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af0020 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152561:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af0020 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152568:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889af8da5100) 00010000:00010000:1.0:1788837778.152571:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837778.152574:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af0020 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152580:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af0020 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152617:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ba00/0x57f6d4e926af0012 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edcb expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152629:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edcb expref: 27 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837778.152641:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:1.0:1788837778.152643:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837778.152645:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9aa00, rc 0) 00000100:00100000:1.0:1788837778.152689:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+27:12454:x1875732012834304:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 8363us (8588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837778.152696:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 249 00000100:00100000:0.0:1788837778.361385:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837778.361415:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036993280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837778.361492:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837778.361553:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036993280 00000100:00100000:0.0:1788837778.361559:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036993280 00000100:00100000:0.0:1788837778.361596:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788837778.361604:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036993280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837778.361632:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788837778.361671:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036993280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837778.361677:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788837778.361719:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036993280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837778.361906:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036993536:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.361940:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837778.362011:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036993792:0@lo:400:kworker.0 00000100:00100000:3.0:1788837778.362059:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036993664:0@lo:400:kworker.0 00000100:00100000:3.0:1788837778.362083:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837778.362103:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036994176:0@lo:400:kworker.0 00000100:00100000:3.0:1788837778.362124:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837778.362145:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036994688:0@lo:400:kworker.0 00000100:00100000:3.0:1788837778.362165:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837778.362197:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036993664 00000100:00100000:3.0:1788837778.362202:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036993664 00000100:00100000:3.0:1788837778.362225:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788837778.362231:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036993664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837778.362269:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036993664:12345-0@lo:400:kworker.0 Request processed in 37us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837778.362276:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788837778.362300:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036993664:0@lo:400:kworker.0 00000100:00100000:3.0:1788837778.362329:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036994176 00000100:00100000:3.0:1788837778.362332:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036994176 00000100:00100000:0.0:1788837778.362388:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036993408:0@lo:400:kworker.0 00000100:00100000:0.0:1788837778.362415:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837778.362435:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036993920:0@lo:400:kworker.0 00000100:00100000:0.0:1788837778.362457:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036993408 00000100:00100000:0.0:1788837778.362459:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036993408 00000100:00100000:0.0:1788837778.362483:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788837778.362487:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036993408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837778.362515:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036993408:12345-0@lo:400:kworker.0 Request processed in 27us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837778.362520:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788837778.367021:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036994688 00000100:00100000:0.0:1788837778.367037:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036994688 00000100:00100000:2.0:1788837778.367179:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837778.367211:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036994304:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.367265:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837778.367281:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036994816:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.367300:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837778.367323:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837778.367330:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036994944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837778.367350:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837778.367377:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837778.367403:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036994432:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.367425:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837778.367461:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036993408:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.367503:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036993536 00000100:00100000:2.0:1788837778.367507:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036993536 00000100:00100000:2.0:1788837778.367543:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036993792 00000100:00100000:2.0:1788837778.367546:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036993792 00000100:00100000:2.0:1788837778.367556:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036993920 00000100:00100000:2.0:1788837778.367558:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036993920 00000100:00100000:3.0:1788837778.367691:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036994432 00000100:00100000:3.0:1788837778.367696:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036994432 00000100:00100000:1.0:1788837778.370044:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788837778.370067:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036993536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837778.370160:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036993536:12345-0@lo:400:kworker.0 Request processed in 102us (8217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837778.370167:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788837778.370220:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788837778.370227:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036993792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837778.370264:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732036993792:12345-0@lo:400:kworker.0 Request processed in 38us (3089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837778.370270:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788837778.370433:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036994304 00000100:00100000:0.0:1788837778.370440:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036994304 00000100:00100000:0.0:1788837778.370453:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036994816 00000100:00100000:0.0:1788837778.370478:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036994816 00000100:00100000:0.0:1788837778.370493:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788837778.370498:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036994688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837778.370537:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036994688:12345-0@lo:400:kworker.0 Request processed in 39us (8371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837778.370542:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788837778.370554:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788837778.370558:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1875732036994304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837778.370580:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1875732036994304:12345-0@lo:400:kworker.0 Request processed in 22us (3315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837778.370585:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788837778.370593:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788837778.370597:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1875732036994816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837778.370616:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1875732036994816:12345-0@lo:400:kworker.0 Request processed in 19us (3315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837778.370620:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788837778.370663:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036994688:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.371490:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788837778.371499:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036993920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.371551:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036993920:12345-0@lo:400:kworker.0 Request processed in 55us (4174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837778.371567:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788837778.371590:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036994944 00000100:00100000:2.0:1788837778.371595:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036994944 00000100:00100000:2.0:1788837778.371615:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788837778.371619:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c36de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875732036994944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837778.371635:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1788837778.371664:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c36de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875732036994944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (4314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837778.371669:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788837778.371706:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036993920:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.371738:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036994944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837778.371748:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732036993792:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.371758:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036994304:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.371765:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036994816:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.371831:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036993536:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.371841:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036994048:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.371874:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837778.371896:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036994048 00000100:00100000:2.0:1788837778.371900:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036994048 00000100:00100000:2.0:1788837778.372267:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788837778.372274:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036994048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.372309:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036994048:12345-0@lo:400:kworker.0 Request processed in 36us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837778.372322:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00010000:00080000:2.0:1788837778.372351:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4490380 x1875732036994048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837778.372361:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036994048:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.372367:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c36dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036994560:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.372387:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837778.372403:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036994560 00000100:00100000:2.0:1788837778.372407:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036994560 00000100:00100000:2.0:1788837778.372427:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788837778.372432:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036994560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.372456:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036994560:12345-0@lo:400:kworker.0 Request processed in 25us (69us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837778.372474:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00010000:00080000:2.0:1788837778.372498:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c36dfb80 x1875732036994560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837778.372508:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036994560:0@lo:400:kworker.0 00000100:00100000:2.0:1788837778.372576:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837778.372583:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036995072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837778.372607:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837778.372626:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036995072 00000100:00100000:2.0:1788837778.372630:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036995072 00000100:00100000:2.0:1788837778.372646:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788837778.372652:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036995072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837778.372661:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1788837778.372693:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036995072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837778.372698:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788837778.372721:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036995072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837778.372754:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788837778.372760:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036994176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837778.373127:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788837778.373135:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036994432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837778.373271:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036994432:12345-0@lo:400:kworker.0 Request processed in 137us (5845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837778.373277:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788837778.373344:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036994432:0@lo:400:kworker.0 00000100:00080000:1.0:1788837778.373437:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837778.373441:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837778.373444:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837778.373446:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837778.375899:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036994176:12345-0@lo:400:kworker.0 Request processed in 3131us (13765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837778.376850:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788837778.379647:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036994176:0@lo:400:kworker.0 00000040:00080000:1.0:1788837778.990518:0:14767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788837778.990530:0:14767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837778.990564:0:14767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788837778.990571:0:14767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788837779.129741:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837779.129753:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837779.129805:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788837779.129812:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788837779.129940:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875732036995200:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788837779.130147:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2629180 going to sleep for 11 seconds 00000100:00100000:1.0:1788837779.135283:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837779.135335:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012834816 00000100:00100000:1.0:1788837779.135345:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012834816 00000100:00100000:1.0:1788837779.135396:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 250 00000100:00100000:1.0:1788837779.135405:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+28:12466:x1875732012834816:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788837779.135443:0:6526:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788837779.135570:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+28:12466:x1875732012834816:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 165us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837779.135577:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 250 00000100:00100000:3.0:1788837779.136844:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875732036995200:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788837779.139037:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837779.139153:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012835072 00000100:00100000:0.0:1788837779.139163:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012835072 00000100:00100000:0.0:1788837779.139230:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 251 00000100:00100000:0.0:1788837779.139239:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+27:12466:x1875732012835072:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837779.139260:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837779.139282:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a000/0x57f6d4e926af002e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003edd2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837779.139634:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926af0035 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837779.139660:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926af0035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837779.139672:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926af0035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837779.139684:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788837779.139821:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a000/0x57f6d4e926af002e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edd2 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837779.139842:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926af0035 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edd2 expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837779.139851:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:0.0:1788837779.139854:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837779.139857:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9ae00, rc 0) 00000100:00100000:0.0:1788837779.139916:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+29:12466:x1875732012835072:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 678us (888us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788837779.139923:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 251 00000100:00100000:3.0:1788837779.142637:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837779.142675:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012835200 00000100:00100000:3.0:1788837779.142684:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012835200 00000100:00100000:3.0:1788837779.142738:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:3.0:1788837779.142747:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+29:2393:x1875732012835200:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837779.142762:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837779.142814:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ae00/0x57f6d4e926af0035 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edd2 expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837779.142834:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:3.0:1788837779.142838:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837779.142887:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3a879e24-3b2f-4404-84c2-9101689d9315+28:2393:x1875732012835200:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 141us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837779.142894:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00010000:00010000:2.0:1788837779.143408:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837779.145882:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837779.145969:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012835456 00000100:00100000:2.0:1788837779.145979:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012835456 00000100:00100000:2.0:1788837779.146151:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 252 00000100:00100000:2.0:1788837779.146161:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+28:12466:x1875732012835456:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788837779.146402:0:9317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926af0043 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837779.146419:0:9317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926af0043 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837779.146430:0:9317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926af0043 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837779.147378:0:9317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926af0043 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837779.147389:0:9317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926af0043 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837779.147396:0:9317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926af0043 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837779.147401:0:9317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837779.147406:0:9317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926af0043 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837779.147414:0:9317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926af0043 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837779.147427:0:9317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:2.0:1788837779.147430:0:9317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788837779.147434:0:9317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926af0043 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837779.147439:0:9317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325000/0x57f6d4e926af0043 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837779.148286:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+29:12466:x1875732012835456:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 2120us (2407us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788837779.148297:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 252 00000040:00080000:3.0:1788837779.152923:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837779.152930:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837779.153918:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788837779.153929:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788837779.164197:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837779.166894:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012835712 00000100:00100000:1.0:1788837779.166908:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012835712 00000100:00100000:1.0:1788837779.166972:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:1.0:1788837779.166982:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+29:12466:x1875732012835712:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788837779.169407:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+30:12466:x1875732012835712:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 2417us (5212us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788837779.169421:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:1.0:1788837779.387825:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837779.387850:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036995328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837779.387922:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837779.388110:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036995328 00000100:00100000:1.0:1788837779.388119:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036995328 00000100:00100000:3.0:1788837779.396562:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788837779.396590:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036995328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837779.396634:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788837779.396756:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036995328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 179us (8833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837779.396765:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788837779.396901:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036995328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837779.443220:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837779.443276:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837779.443297:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837779.443326:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837779.443345:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837779.443361:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837779.443386:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837779.443411:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012836224 00000100:00100000:2.0:1788837779.443420:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012836224 00000100:00100000:2.0:1788837779.443479:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012836352 00000100:00100000:2.0:1788837779.443483:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012836352 00000100:00100000:2.0:1788837779.443512:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 135 00000100:00100000:2.0:1788837779.443522:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af76fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:2396:x1875732012836224:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837779.443595:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af76fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:2396:x1875732012836224:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 74us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837779.443602:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 135 00000100:00100000:2.0:1788837779.443738:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 136 00000100:00100000:2.0:1788837779.443744:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012836352:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837779.443766:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012836352:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837779.443772:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 136 00000100:00100000:3.0:1788837779.444300:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012835968 00000100:00100000:3.0:1788837779.444305:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012835968 00000100:00100000:3.0:1788837779.444346:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012836480 00000100:00100000:3.0:1788837779.444349:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012836480 00000100:00100000:3.0:1788837779.444365:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012836096 00000100:00100000:3.0:1788837779.444368:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012836096 00000100:00100000:3.0:1788837779.444380:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012836608 00000100:00100000:3.0:1788837779.444383:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012836608 00000100:00100000:3.0:1788837779.444396:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 315 00000100:00100000:3.0:1788837779.444403:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+30:2396:x1875732012835968:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837779.444441:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+30:2396:x1875732012835968:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 39us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837779.444459:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 315 00000100:00100000:3.0:1788837779.444472:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 316 00000100:00100000:3.0:1788837779.444477:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012836480:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837779.444500:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012836480:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837779.444506:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 316 00000100:00100000:3.0:1788837779.444518:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 317 00000100:00100000:3.0:1788837779.444524:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012836096:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837779.444547:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012836096:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837779.444553:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 317 00000100:00100000:3.0:1788837779.444577:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 318 00000100:00100000:3.0:1788837779.444583:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012836608:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837779.444607:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012836608:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 25us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837779.444613:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 318 00000100:00100000:1.0:1788837779.444753:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012835840 00000100:00100000:1.0:1788837779.444758:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012835840 00000100:00100000:1.0:1788837779.444822:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 387 00000100:00100000:1.0:1788837779.444828:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2396:x1875732012835840:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837779.444852:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2396:x1875732012835840:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 25us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837779.444864:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 387 00000100:00080000:1.0:1788837779.444888:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837779.444892:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837779.444895:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788837780.153013:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788837780.909615:0:14819:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788837780.909624:0:14819:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788837780.909656:0:14819:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788837780.909661:0:14819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788837781.110094:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837781.113200:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012836864 00000100:00100000:1.0:1788837781.113217:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012836864 00000100:00100000:1.0:1788837781.113308:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 253 00000100:00100000:1.0:1788837781.113320:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+30:12487:x1875732012836864:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788837781.113353:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837781.113377:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926af004a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003edd9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788837781.113471:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788837781.113670:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af0051 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837781.113686:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af0051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837781.113696:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af0051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837781.113709:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788837781.114099:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8c00/0x57f6d4e926af004a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edd9 expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837781.114119:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af0051 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edd9 expref: 32 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837781.114147:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:1.0:1788837781.114151:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788837781.114154:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9200, rc 0) 00000100:00100000:1.0:1788837781.114222:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3a879e24-3b2f-4404-84c2-9101689d9315+32:12487:x1875732012836864:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 905us (4140us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788837781.114229:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 253 00000100:00100000:0.0:1788837781.117360:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837781.117489:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012836992 00000100:00100000:3.0:1788837781.117501:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012836992 00000100:00100000:3.0:1788837781.117604:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 254 00000100:00100000:3.0:1788837781.117616:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+32:12487:x1875732012836992:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:3.0:1788837781.117687:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af005f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837781.117705:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af005f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837781.117717:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af005f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837781.117764:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af005f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837781.117815:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af005f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837781.117824:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af005f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837781.117831:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac6000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837781.117835:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af005f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837781.117858:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af005f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837781.117872:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:3.0:1788837781.117875:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837781.117880:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af005f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837781.117887:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af005f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837781.117962:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+32:12487:x1875732012836992:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 349us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837781.117970:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 254 00010000:00010000:0.0:1788837781.177246:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837781.218326:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837781.222844:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012837120 00000100:00100000:0.0:1788837781.222861:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012837120 00000100:00100000:0.0:1788837781.222959:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 78 00000100:00100000:0.0:1788837781.223114:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+7:2393:x1875732012837120:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:0.0:1788837781.223131:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837781.223152:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002086708e/0x57f6d4e926af0066 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ede0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788837781.223176:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f7f91, atime: 0x6a9f7f91, ctime: 0x6a9f7f91, blocks: 0x8 00010000:00010000:0.0:1788837781.223196:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=398s v=(0 0) 00010000:00010000:0.0:1788837781.223200:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837781.223220:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002086708e/0x57f6d4e926af0066 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ede0 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837781.223238:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002086708e/0x57f6d4e926af0066 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ede0 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837781.223250:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9be00, rc 0) 00000100:00100000:0.0:1788837781.223321:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+8:2393:x1875732012837120:12345-192.168.201.3@tcp:101:cat.0 Request processed in 335us (5006us total) trans 0 rc 0/0 00000100:00080000:2.0:1788837781.223355:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837781.231369:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837781.231584:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 78 00000100:00100000:3.0:1788837781.231647:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012837248 00000100:00100000:3.0:1788837781.231657:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012837248 00002000:00100000:3.0:1788837781.231706:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8899c3dd4a80 x1875732012837248/t0(0) o3->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:437/0 lens 488/0 e 0 to 0 dl 1788837792 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788837781.231717:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c3dd4a80 with x1875732012837248 ext(0->4095) 00002000:00010000:3.0:1788837781.231724:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8899c3dd4a80 00000100:00100000:3.0:1788837781.231810:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:3.0:1788837781.231819:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3a879e24-3b2f-4404-84c2-9101689d9315+8:2394:x1875732012837248:12345-192.168.201.3@tcp:3:cat.0 00000100:00100000:3.0:1788837781.232012:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3a879e24-3b2f-4404-84c2-9101689d9315+8:2394:x1875732012837248:12345-192.168.201.3@tcp:3:cat.0 Request processed in 190us (648us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788837781.232020:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00002000:00100000:3.0:1788837781.232026:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8899c3dd4a80 x1875732012837248/t0(0) o3->3a879e24-3b2f-4404-84c2-9101689d9315@192.168.201.3@tcp:437/0 lens 488/4536 e 0 to 0 dl 1788837792 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788837781.232045:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8899c3dd4a80 with x1875732012837248 ext(0->4095) 00002000:00010000:3.0:1788837781.232048:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8899c3dd4a80 00000004:00080000:0.0:1788837781.945349:0:8543:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398816569238ns, next at 399816566293ns, rc = 0 00000100:00100000:1.0:1788837781.945452:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036995456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837781.945522:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837781.945708:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036995456 00000100:00100000:0.0:1788837781.945725:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036995456 00000100:00100000:0.0:1788837781.945814:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788837781.945824:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875732036995456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837781.946246:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:2.0:1788837781.946286:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837781.946303:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875732036995456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 479us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837781.946328:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788837781.946515:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036995456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837781.946536:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837781.946544:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036995584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837781.946591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837781.950104:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036995584 00000100:00100000:2.0:1788837781.950120:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036995584 00000100:00100000:2.0:1788837781.950223:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788837781.950233:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b01d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036995584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837781.950261:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788837781.950343:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b01d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732036995584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (3751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837781.950350:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1788837781.951540:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837781.951943:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732036995584:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788837782.073335:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788837782.201072:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837782.264947:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788837782.264959:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788837782.264981:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788837782.264988:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1788837782.974465:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:1.0:1788837783.225257:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837783.484525:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837783.484547:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036995712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837783.484618:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837783.484682:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036995712 00000100:00100000:0.0:1788837783.484688:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036995712 00000100:00100000:0.0:1788837783.484746:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788837783.484755:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036995712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837783.484813:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788837783.484859:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036995712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837783.484866:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788837783.484984:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036995712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837783.487139:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837783.487161:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036995840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837783.487229:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837783.487285:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036995840 00000100:00100000:2.0:1788837783.487291:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036995840 00000100:00100000:2.0:1788837783.487343:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788837783.487351:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036995840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837783.487382:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837783.487426:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036995840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837783.487433:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1788837783.487453:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837783.487481:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036995840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837783.487642:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837783.487652:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036995968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837783.487682:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837783.487719:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036995968 00000100:00100000:1.0:1788837783.487723:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036995968 00000100:00100000:1.0:1788837783.487752:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788837783.487757:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036995968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837783.487767:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837783.487830:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732036995968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837783.487846:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1788837783.487862:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837783.487877:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788837783.487882:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1788837783.487899:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8899c4490e00, transno 4294967311 00000100:00100000:1.0:1788837783.487927:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036995968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837783.488354:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036996096:0@lo:400:kworker.0 00000100:00100000:1.0:1788837783.488393:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837783.488417:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036996608:0@lo:400:kworker.0 00000100:00100000:1.0:1788837783.488442:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837783.488460:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c24e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036997120:0@lo:400:kworker.0 00000100:00100000:1.0:1788837783.488481:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837783.488499:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788837783.488505:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036996480:0@lo:400:kworker.0 00000100:00100000:1.0:1788837783.488526:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837783.488544:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c24e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036996992:0@lo:400:kworker.0 00000100:00100000:1.0:1788837783.488583:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837783.488610:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036996608 00000100:00100000:1.0:1788837783.488615:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036996608 00000100:00100000:1.0:1788837783.488649:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036997120 00000100:00100000:1.0:1788837783.488653:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036997120 00000100:00100000:1.0:1788837783.488673:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036996480 00000100:00100000:1.0:1788837783.488676:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036996480 00000100:00100000:1.0:1788837783.488690:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788837783.488697:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036996608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837783.488750:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036996608:12345-0@lo:400:kworker.0 Request processed in 53us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837783.488763:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788837783.488800:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788837783.488806:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036997120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837783.488835:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036997120:12345-0@lo:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837783.488841:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788837783.488853:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788837783.488858:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036996480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837783.488884:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732036996480:12345-0@lo:400:kworker.0 Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837783.488890:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788837783.488914:0:14078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036996992 00000100:00100000:1.0:1788837783.488918:0:14078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036996992 00000100:00100000:1.0:1788837783.488945:0:14078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788837783.488951:0:14078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3649:x1875732036996992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837783.488981:0:14078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3649:x1875732036996992:12345-0@lo:400:kworker.0 Request processed in 31us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837783.488987:0:14078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1788837783.489012:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837783.489015:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837783.489024:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036996224:0@lo:400:kworker.0 00000100:00100000:1.0:1788837783.489049:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837783.489066:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036996736:0@lo:400:kworker.0 00000100:00100000:1.0:1788837783.489086:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837783.489102:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c24e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036997248:0@lo:400:kworker.0 00000100:00100000:1.0:1788837783.489132:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837783.489149:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788837783.489155:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036996352:0@lo:400:kworker.0 00000100:00100000:1.0:1788837783.489178:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837783.490258:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036996096 00000100:00100000:0.0:1788837783.490268:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036996096 00000100:00100000:0.0:1788837783.490314:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788837783.490323:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036996096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837783.490378:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732036996096:12345-0@lo:400:kworker.0 Request processed in 57us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837783.490386:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788837783.490440:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036996224 00000100:00100000:0.0:1788837783.490444:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036996224 00000100:00100000:0.0:1788837783.490465:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036996736 00000100:00100000:0.0:1788837783.490468:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036996736 00000100:00100000:0.0:1788837783.490489:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036997248 00000100:00100000:0.0:1788837783.490491:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036997248 00000100:00100000:0.0:1788837783.490518:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788837783.490524:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036996224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837783.490557:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732036996224:12345-0@lo:400:kworker.0 Request processed in 32us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837783.490563:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788837783.490574:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788837783.490579:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036996736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837783.490604:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036996736:12345-0@lo:400:kworker.0 Request processed in 25us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837783.490609:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788837783.490619:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788837783.490625:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036997248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837783.490648:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036997248:12345-0@lo:400:kworker.0 Request processed in 24us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837783.490654:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788837783.490694:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732036996480:0@lo:400:kworker.0 00000100:00100000:0.0:1788837783.490720:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c24e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732036996992:0@lo:400:kworker.0 00000100:00100000:0.0:1788837783.490730:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732036996096:0@lo:400:kworker.0 00000100:00100000:0.0:1788837783.490741:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036996608:0@lo:400:kworker.0 00000100:00100000:0.0:1788837783.490751:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c24e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036997120:0@lo:400:kworker.0 00000100:00100000:0.0:1788837783.490838:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036996352 00000100:00100000:0.0:1788837783.490843:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036996352 00000100:00100000:0.0:1788837783.490867:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788837783.490873:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036996352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837783.490926:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036996352:12345-0@lo:400:kworker.0 Request processed in 52us (1746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837783.490933:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1788837783.490964:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837783.491891:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036996864:0@lo:400:kworker.0 00000004:00080000:0.0:1788837783.497294:0:6503:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:0.0:1788837783.497336:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1788837783.497360:0:6503:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff889b01a523c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788837783.497365:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889afa679800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff889b01a52d80 00000020:00080000:0.0:1788837783.497369:0:6503:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889afa679400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8899c351c400 00000020:00080000:0.0:1788837783.497385:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1788837783.497478:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788837783.497546:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788837783.497573:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aeffe1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837783.497584:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aeffe1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837783.497592:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aeffe1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837783.497599:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837783.497603:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aeffe1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837783.497613:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aeffe1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837783.497631:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889af8da5800) 00010000:00010000:3.0:1788837783.497634:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837783.497639:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aeffe1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837783.497660:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b000/0x57f6d4e926aeffe1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837783.497743:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036997376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788837783.497862:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837783.498028:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036997376 00000100:00100000:3.0:1788837783.498036:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036997376 00000100:00100000:3.0:1788837783.498082:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788837783.498101:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3651:x1875732036997376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788837783.498212:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788837783.498215:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788837777 -> 1788837777 00002000:00010000:3.0:1788837783.498218:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1788837777 -> 1788837777 00002000:00010000:3.0:1788837783.498220:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788837777 -> 1788837777 00002000:00010000:3.0:1788837783.498222:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788837783.498264:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3651:x1875732036997376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 165us (402us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788837783.498271:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000004:00080000:3.0:1788837783.498469:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8899c4491f80/2, rc 0, transno 4294967325 00000100:00100000:3.0:1788837783.498475:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036997376:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1788837783.501525:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1788837783.501539:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:2.0:1788837783.506987:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837783.507064:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732036996224:0@lo:400:kworker.0 00010000:00080000:2.0:1788837783.507093:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c44cbb80 x1875732036996736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837783.507104:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036996736:0@lo:400:kworker.0 00010000:00080000:2.0:1788837783.507116:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c24e8380 x1875732036997248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837783.507137:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c24e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036997248:0@lo:400:kworker.0 00000100:00100000:2.0:1788837783.507173:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036996352:0@lo:400:kworker.0 00000100:00100000:0.0:1788837783.508076:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036996864 00000100:00100000:0.0:1788837783.508096:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036996864 00000100:00100000:0.0:1788837783.508173:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788837783.508183:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036996864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837783.508253:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036996864:12345-0@lo:400:kworker.0 Request processed in 71us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837783.508259:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788837783.508297:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036996864:0@lo:400:kworker.0 00000100:00080000:1.0:1788837783.508935:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837784.251170:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837784.505740:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837784.505770:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036997504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837784.505888:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837784.506009:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036997504 00000100:00100000:3.0:1788837784.506018:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036997504 00000100:00100000:3.0:1788837784.506069:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788837784.506078:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036997504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837784.506118:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788837784.506178:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732036997504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837784.506206:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788837784.506296:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732036997504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837784.565040:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837784.565088:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837784.565149:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012837376 00000100:00100000:0.0:1788837784.565160:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012837376 00000100:00100000:0.0:1788837784.565226:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 389 00000100:00100000:0.0:1788837784.565236:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2396:x1875732012837376:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837784.565372:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837784.565383:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2396:x1875732012837376:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837784.565392:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 389 00000100:00100000:0.0:1788837784.565454:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012837888 00000100:00100000:0.0:1788837784.565459:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012837888 00000100:00100000:3.0:1788837784.565480:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837784.565510:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 139 00000100:00100000:3.0:1788837784.565514:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837784.565523:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012837888:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837784.565543:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837784.565701:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012837888:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 171us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837784.565708:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 139 00000100:00100000:0.0:1788837784.565720:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012837760 00000100:00100000:0.0:1788837784.565723:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012837760 00000100:00100000:0.0:1788837784.565747:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 140 00000100:00100000:0.0:1788837784.565753:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:2396:x1875732012837760:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837784.565867:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012837632 00000100:00100000:1.0:1788837784.565872:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012837632 00000100:00100000:3.0:1788837784.565886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837784.568360:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3a879e24-3b2f-4404-84c2-9101689d9315+7:2396:x1875732012837760:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 2593us (2805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837784.568376:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 140 00000100:00100000:1.0:1788837784.568474:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012838144 00000100:00100000:1.0:1788837784.568482:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012838144 00000100:00100000:1.0:1788837784.568518:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012837504 00000100:00100000:1.0:1788837784.568521:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012837504 00000100:00100000:1.0:1788837784.568538:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012838016 00000100:00100000:1.0:1788837784.568541:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012838016 00000100:00080000:3.0:1788837784.568557:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837784.568563:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788837784.568565:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837784.568569:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837784.568574:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 325 00000100:00100000:1.0:1788837784.568584:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012837632:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837784.568616:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 326 00000100:00100000:3.0:1788837784.568628:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012838144:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837784.568655:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2396:x1875732012837632:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 71us (3565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837784.568663:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 325 00000100:00100000:3.0:1788837784.568668:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012838144:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 41us (3187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837784.568678:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 326 00000100:00100000:1.0:1788837784.568684:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 327 00000100:00100000:1.0:1788837784.568705:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+18:2396:x1875732012837504:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837784.568712:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 328 00000100:00100000:3.0:1788837784.568722:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012838016:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837784.568738:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+18:2396:x1875732012837504:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 34us (3226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837784.568757:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2396:x1875732012838016:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 35us (2870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837784.568764:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 327 00000100:00100000:3.0:1788837784.568771:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 328 00010000:00010000:0.0:1788837785.274082:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837785.892716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837785.892828:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012838272 00000100:00100000:0.0:1788837785.892839:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012838272 00000100:00100000:0.0:1788837785.892913:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 255 00000100:00100000:0.0:1788837785.892923:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+18:12132:x1875732012838272:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788837785.893019:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3a879e24-3b2f-4404-84c2-9101689d9315+18:12132:x1875732012838272:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837785.893027:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 255 00000100:00100000:2.0:1788837785.895248:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837785.898648:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012838400 00000100:00100000:3.0:1788837785.898672:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012838400 00000100:00100000:3.0:1788837785.898908:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 256 00000100:00100000:3.0:1788837785.898919:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+5:12132:x1875732012838400:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788837785.899038:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3a879e24-3b2f-4404-84c2-9101689d9315+5:12132:x1875732012838400:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 Request processed in 121us (3797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837785.899046:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 256 00000100:00100000:3.0:1788837785.906299:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837785.906389:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012838656 00000100:00100000:1.0:1788837785.906399:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012838656 00000100:00100000:1.0:1788837785.906457:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:1.0:1788837785.906463:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+18:12132:x1875732012838656:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788837785.906696:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3a879e24-3b2f-4404-84c2-9101689d9315+19:12132:x1875732012838656:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 231us (402us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788837785.906703:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:1.0:1788837786.083215:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837786.083316:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012838784 00000100:00100000:0.0:1788837786.083327:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012838784 00000100:00100000:0.0:1788837786.083404:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 257 00000100:00100000:0.0:1788837786.083415:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:12943:x1875732012838784:12345-192.168.201.3@tcp:101:lsof.0 00010000:00010000:0.0:1788837786.083434:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837786.083455:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af006d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ede7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837786.083519:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a000/0x57f6d4e926af0074 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788837786.083624:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788837786.083721:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a000/0x57f6d4e926af0074 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837786.083737:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a000/0x57f6d4e926af0074 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837786.083892:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788837786.083896:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788837786.083919:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a000/0x57f6d4e926af0074 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837786.083942:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9b600/0x57f6d4e926af006d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ede7 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837786.083959:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a000/0x57f6d4e926af0074 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ede7 expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837786.083968:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889af8da5c00) 00010000:00010000:0.0:1788837786.083971:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837786.083987:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9a000, rc 0) 00000100:00100000:0.0:1788837786.084079:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:12943:x1875732012838784:12345-192.168.201.3@tcp:101:lsof.0 Request processed in 666us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837786.084087:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 257 00010000:00010000:1.0:1788837786.299021:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837787.065165:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837787.065190:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036997632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837787.065269:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837787.065391:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036997632 00000100:00100000:0.0:1788837787.065400:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036997632 00000100:00100000:0.0:1788837787.065461:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788837787.065470:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036997632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837787.065499:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788837787.065556:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036997632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837787.065564:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788837787.065612:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1788837787.065622:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8899c4492a00, transno 4294967322 00000004:00080000:0.0:1788837787.065632:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967325 00000004:00080000:0.0:1788837787.065683:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8899c4491f80, transno 4294967325 00000100:00100000:0.0:1788837787.065695:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036997632:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837787.066032:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837787.066220:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837787.066232:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036997760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837787.066268:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837787.066352:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036997760 00000100:00100000:1.0:1788837787.066357:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036997760 00000100:00100000:1.0:1788837787.066404:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788837787.066411:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036997760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788837787.066424:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788837787.066464:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036997760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837787.066471:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788837787.066504:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036997760:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788837787.066558:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837787.321504:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837788.345035:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837788.601040:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036997888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837788.601118:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837788.601216:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036997888 00000100:00100000:1.0:1788837788.601223:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036997888 00000100:00100000:1.0:1788837788.601278:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788837788.601304:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036997888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788837788.601342:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837788.601385:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732036997888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837788.601392:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1788837788.601413:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837788.601444:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732036997888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837788.602170:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036998272:0@lo:400:kworker.0 00000100:00100000:0.0:1788837788.602208:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837788.602232:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036998784:0@lo:400:kworker.0 00000100:00100000:0.0:1788837788.602256:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837788.602279:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036999296:0@lo:400:kworker.0 00000100:00100000:0.0:1788837788.602299:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837788.602317:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788837788.602345:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036998400:0@lo:400:kworker.0 00000100:00100000:0.0:1788837788.602371:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837788.602388:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036998912:0@lo:400:kworker.0 00000100:00100000:0.0:1788837788.602411:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837788.602425:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036999424:0@lo:400:kworker.0 00000100:00100000:0.0:1788837788.602443:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837788.602467:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036998272 00000100:00100000:0.0:1788837788.602472:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036998272 00000100:00100000:0.0:1788837788.602514:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788837788.602522:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036998272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837788.602572:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036998272:12345-0@lo:400:kworker.0 Request processed in 52us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837788.602580:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788837788.603377:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036998784 00000100:00100000:1.0:1788837788.603386:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036998784 00000100:00100000:1.0:1788837788.603431:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036999296 00000100:00100000:1.0:1788837788.603434:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036999296 00000100:00100000:1.0:1788837788.603453:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036998400 00000100:00100000:1.0:1788837788.603455:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036998400 00000100:00100000:1.0:1788837788.603470:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788837788.603477:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036998784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837788.603540:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732036998784:12345-0@lo:400:kworker.0 Request processed in 63us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837788.603547:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788837788.603562:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788837788.603568:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036999296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837788.603596:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732036999296:12345-0@lo:400:kworker.0 Request processed in 28us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837788.603601:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788837788.603613:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788837788.603908:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036998272:0@lo:400:kworker.0 00010000:00080000:0.0:1788837788.603924:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889affc4fb80 x1875732036998784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837788.603934:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732036998784:0@lo:400:kworker.0 00010000:00080000:0.0:1788837788.603945:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889affc4ce00 x1875732036999296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837788.603954:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732036999296:0@lo:400:kworker.0 00000100:00100000:0.0:1788837788.604009:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036998144:0@lo:400:kworker.0 00000100:00100000:0.0:1788837788.604043:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837788.604072:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036998656:0@lo:400:kworker.0 00000100:00100000:0.0:1788837788.604090:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837788.604114:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036999168:0@lo:400:kworker.0 00000100:00100000:0.0:1788837788.604132:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837788.604239:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036998400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837788.604278:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732036998400:12345-0@lo:400:kworker.0 Request processed in 659us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837788.604292:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788837788.604306:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036998144 00000100:00100000:1.0:1788837788.604310:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036998144 00000100:00100000:1.0:1788837788.604338:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036998656 00000100:00100000:1.0:1788837788.604341:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036998656 00000100:00100000:1.0:1788837788.604353:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036999168 00000100:00100000:1.0:1788837788.604355:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036999168 00000100:00100000:1.0:1788837788.604367:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788837788.604372:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036998144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837788.604400:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732036998144:12345-0@lo:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837788.604406:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788837788.604418:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788837788.604423:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036998656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837788.604446:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732036998656:12345-0@lo:400:kworker.0 Request processed in 24us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837788.604453:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788837788.604463:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788837788.604469:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036999168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837788.604686:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732036999168:12345-0@lo:400:kworker.0 Request processed in 146us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837788.604694:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:1.0:1788837788.604718:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837788.604722:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837788.604745:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732036998400:0@lo:400:kworker.0 00000100:00100000:1.0:1788837788.604794:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036998016:0@lo:400:kworker.0 00000100:00100000:1.0:1788837788.604836:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837788.604862:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036998528:0@lo:400:kworker.0 00000100:00100000:1.0:1788837788.604886:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837788.604906:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036999040:0@lo:400:kworker.0 00000100:00100000:1.0:1788837788.604928:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837788.604946:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036999552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837788.604965:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837788.604995:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036998016 00000100:00100000:1.0:1788837788.604998:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036998016 00000100:00100000:1.0:1788837788.605027:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788837788.605034:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036998016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837788.605070:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732036998016:12345-0@lo:400:kworker.0 Request processed in 36us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837788.605076:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788837788.605103:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036998528 00000100:00100000:1.0:1788837788.605107:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036998528 00000100:00100000:1.0:1788837788.605123:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036999552 00000100:00100000:1.0:1788837788.605126:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036999552 00000100:00100000:1.0:1788837788.605137:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788837788.605630:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036998912 00000100:00100000:2.0:1788837788.605635:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036998912 00000100:00100000:2.0:1788837788.605668:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036999424 00000100:00100000:2.0:1788837788.605671:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036999424 00000100:00100000:2.0:1788837788.605693:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036999040 00000100:00100000:2.0:1788837788.605696:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036999040 00000100:00100000:2.0:1788837788.605708:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788837788.605714:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036998912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837788.605761:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036998912:12345-0@lo:400:kworker.0 Request processed in 47us (3349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837788.605768:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788837788.605800:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788837788.605807:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036999424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837788.605834:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732036999424:12345-0@lo:400:kworker.0 Request processed in 29us (3390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837788.605839:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788837788.605849:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788837788.605854:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036999040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837788.605876:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036999040:12345-0@lo:400:kworker.0 Request processed in 23us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837788.605882:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1788837788.605902:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837788.605937:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036998912:0@lo:400:kworker.0 00000100:00100000:2.0:1788837788.605946:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732036999424:0@lo:400:kworker.0 00000100:00100000:2.0:1788837788.606014:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788837788.606022:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036999552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788837788.606047:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788837788.606079:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036999552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837788.606084:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788837788.606127:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732036998016:0@lo:400:kworker.0 00000100:00100000:2.0:1788837788.606138:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036999040:0@lo:400:kworker.0 00000100:00100000:2.0:1788837788.606163:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036999552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837788.606746:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732036998144:0@lo:400:kworker.0 00000100:00100000:0.0:1788837788.606758:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732036998656:0@lo:400:kworker.0 00000100:00100000:0.0:1788837788.606768:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732036999168:0@lo:400:kworker.0 00000100:00100000:3.0:1788837788.606930:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837788.606939:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036999680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837788.606978:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837788.607010:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036999680 00000100:00100000:3.0:1788837788.607014:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036999680 00000100:00100000:3.0:1788837788.607044:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788837788.607051:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036999680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837788.607065:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837788.607097:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036999680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837788.607105:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788837788.607135:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036999680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837788.607251:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732036998528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837788.607706:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732036998528:12345-0@lo:400:kworker.0 Request processed in 2562us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837788.607714:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788837788.617090:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732036998528:0@lo:400:kworker.0 00000001:00080000:0.0:1788837789.118163:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:0.0:1788837789.118178:0:6503:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788837789.118576:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788837789.118588:0:6556:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788837789.371800:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788837789.548366:0:15016:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:23:08 (1788837788) 00000100:00100000:2.0:1788837789.627730:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036999808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837789.628361:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837789.628476:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036999808 00000100:00100000:3.0:1788837789.628484:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036999808 00000100:00100000:3.0:1788837789.628531:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788837789.628540:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036999808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837789.628575:0:7894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788837789.629475:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732036999808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 932us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837789.629486:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788837789.630197:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732036999808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837789.687530:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837789.687562:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837789.687591:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837789.687626:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837789.687641:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837789.687657:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837789.687688:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837789.687713:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012838912 00000100:00100000:1.0:1788837789.687722:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012838912 00000100:00100000:1.0:1788837789.687769:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 391 00000100:00100000:1.0:1788837789.687798:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012838912:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837789.688176:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012838912:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 396us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837789.688184:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 391 00000100:00100000:1.0:1788837789.688221:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012839168 00000100:00100000:1.0:1788837789.688225:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012839168 00000100:00100000:1.0:1788837789.688260:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012839680 00000100:00100000:1.0:1788837789.688263:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012839680 00000100:00100000:1.0:1788837789.688277:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012839040 00000100:00100000:1.0:1788837789.688280:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012839040 00000100:00100000:1.0:1788837789.688293:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012839552 00000100:00100000:1.0:1788837789.688296:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012839552 00000100:00100000:1.0:1788837789.688309:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 335 00000100:00100000:1.0:1788837789.688315:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012839168:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837789.688345:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012839168:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 30us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837789.688351:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 335 00000100:00100000:1.0:1788837789.688363:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 336 00000100:00100000:1.0:1788837789.688369:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012839680:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837789.688403:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2393:x1875732012839680:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 34us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837789.688409:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 336 00000100:00100000:1.0:1788837789.688421:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 337 00000100:00100000:1.0:1788837789.688426:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+18:2393:x1875732012839040:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837789.688455:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+18:2393:x1875732012839040:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 28us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837789.688460:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 337 00000100:00100000:1.0:1788837789.688471:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 338 00000100:00100000:1.0:1788837789.688476:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:2393:x1875732012839552:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837789.688497:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:2393:x1875732012839552:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 21us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837789.688503:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 338 00000100:00100000:1.0:1788837789.688522:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012839424 00000100:00100000:1.0:1788837789.688525:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012839424 00000100:00100000:1.0:1788837789.688551:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012839296 00000100:00100000:1.0:1788837789.688554:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012839296 00000100:00100000:1.0:1788837789.688574:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 144 00000100:00100000:1.0:1788837789.688581:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012839424:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837789.688620:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2393:x1875732012839424:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 39us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837789.688626:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 144 00000100:00100000:1.0:1788837789.688638:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 145 00000100:00100000:1.0:1788837789.688644:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:2393:x1875732012839296:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837789.688676:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3a879e24-3b2f-4404-84c2-9101689d9315+7:2393:x1875732012839296:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 32us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837789.688682:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 145 00000100:00080000:2.0:1788837789.689945:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837789.689951:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837789.689954:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837789.689956:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788837790.398555:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837791.417282:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837792.185192:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036999936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837792.185275:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837792.185381:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732036999936 00000100:00100000:0.0:1788837792.185389:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732036999936 00000100:00100000:0.0:1788837792.185450:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788837792.185460:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036999936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837792.185487:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788837792.185525:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732036999936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837792.185531:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788837792.185592:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732036999936:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837792.185661:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837792.186710:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837792.189457:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037000064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837792.189535:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837792.189619:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037000064 00000100:00100000:0.0:1788837792.189628:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037000064 00000100:00100000:0.0:1788837792.189699:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788837792.189709:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037000064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837792.189734:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:3.0:1788837792.189858:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837792.189925:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037000064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 206us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837792.189945:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788837792.192174:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037000064:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788837792.316889:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788837792.448139:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788837792.505149:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788837792.505158:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788837792.506344:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788837792.506354:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788837793.465550:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837793.468947:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837793.469019:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012839936 00000100:00100000:2.0:1788837793.469029:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012839936 00000100:00100000:2.0:1788837793.469218:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:2.0:1788837793.469230:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+18:13166:x1875732012839936:12345-192.168.201.3@tcp:35:umount.0 00000100:00100000:2.0:1788837793.469489:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+19:13166:x1875732012839936:12345-192.168.201.3@tcp:35:umount.0 Request processed in 261us (551us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788837793.469498:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00080000:3.0:1788837793.474925:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837793.482992:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837793.492071:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012840192 00000100:00100000:2.0:1788837793.492088:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012840192 00000100:00100000:2.0:1788837793.492163:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:2.0:1788837793.492173:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+19:13166:x1875732012840192:12345-192.168.201.3@tcp:35:umount.0 00000100:00100000:2.0:1788837793.492491:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+20:13166:x1875732012840192:12345-192.168.201.3@tcp:35:umount.0 Request processed in 315us (9504us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788837793.492500:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:0.0:1788837793.495921:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837793.508145:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012840448 00000100:00100000:2.0:1788837793.508161:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012840448 00000100:00100000:2.0:1788837793.508233:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:2.0:1788837793.508244:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aded56450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+20:13166:x1875732012840448:12345-192.168.201.3@tcp:35:umount.0 00000100:00100000:2.0:1788837793.508490:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aded56450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+21:13166:x1875732012840448:12345-192.168.201.3@tcp:35:umount.0 Request processed in 247us (12579us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788837793.508498:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:3.0:1788837793.511073:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837793.511166:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012840704 00000100:00100000:2.0:1788837793.511175:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012840704 00000100:00100000:2.0:1788837793.511237:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:2.0:1788837793.511247:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+21:13166:x1875732012840704:12345-192.168.201.3@tcp:35:umount.0 00000100:00100000:2.0:1788837793.511555:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3a879e24-3b2f-4404-84c2-9101689d9315+22:13166:x1875732012840704:12345-192.168.201.3@tcp:35:umount.0 Request processed in 309us (492us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788837793.511563:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:3.0:1788837793.517617:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837793.517668:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837793.517702:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837793.517875:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012840960 00000100:00100000:3.0:1788837793.517888:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837793.517890:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012840960 00000100:00100000:3.0:1788837793.517916:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012841216 00000100:00100000:3.0:1788837793.517922:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012841216 00000100:00100000:2.0:1788837793.517956:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012840832 00000100:00100000:2.0:1788837793.517972:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012840832 00000100:00100000:3.0:1788837793.517976:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00100000:3.0:1788837793.517989:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+5:2392:x1875732012841216:12345-192.168.201.3@tcp:9:umount.0 00000100:00100000:2.0:1788837793.517992:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012841088 00000100:00100000:2.0:1788837793.518003:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012841088 00000100:00100000:2.0:1788837793.518020:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:2.0:1788837793.518027:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+15:2393:x1875732012840960:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837793.518038:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:3.0:1788837793.518041:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aef369 00000100:00080000:3.0:1788837793.518053:0:8440:0:(import.c:65:import_set_state_nolock()) ffff8899c356a000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788837793.518059:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6da400/0x57f6d4e926aeef8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e8fb expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837793.518075:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:3.0:1788837793.518106:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788837793.518136:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+14:2393:x1875732012840960:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 109us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.518144:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:2.0:1788837793.518163:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:2.0:1788837793.518169:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+13:2393:x1875732012840832:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837793.518177:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837793.518189:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b17600/0x57f6d4e926aeefcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e93a expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837793.518209:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837793.518232:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:2393:x1875732012840832:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 62us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.518246:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:3.0:1788837793.518260:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3a879e24-3b2f-4404-84c2-9101689d9315+2:2392:x1875732012841216:12345-192.168.201.3@tcp:9:umount.0 Request processed in 274us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.518266:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:3.0:1788837793.518274:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00100000:2.0:1788837793.518279:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:2393:x1875732012841088:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837793.518289:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837793.518299:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa790e00/0x57f6d4e926aef274 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea13 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788837793.518302:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788837793.518311:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837793.518333:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2393:x1875732012841088:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 58us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.518340:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 22 00010000:00010000:1.0:1788837793.518818:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837793.524173:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837793.524864:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012841600 00000100:00100000:1.0:1788837793.524876:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012841600 00000100:00100000:1.0:1788837793.524988:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 81 00000100:00100000:1.0:1788837793.524997:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+7:2392:x1875732012841600:12345-192.168.201.3@tcp:9:umount.0 00000020:00000080:1.0:1788837793.525034:0:8441:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aef5df 00000020:00010000:1.0:1788837793.525042:0:8441:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8899c3568000: total 0 00000100:00080000:1.0:1788837793.525046:0:8441:0:(import.c:65:import_set_state_nolock()) ffff8899c356f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837793.525097:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788837793.525253:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3a879e24-3b2f-4404-84c2-9101689d9315+5:2392:x1875732012841600:12345-192.168.201.3@tcp:9:umount.0 Request processed in 256us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837793.525261:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 81 00000020:00010000:0.0:1788837793.525608:0:6512:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8899c3568000: total 0 00010000:00010000:0.0:1788837793.525659:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8899c3568000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788837793.525709:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cd02cf4/0x57f6d4e926aef997 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebfd expref: 4 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.525742:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002086708e/0x57f6d4e926af0066 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ede0 expref: 3 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.525763:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8899c3568000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788837793.525810:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837793.525812:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837793.525814:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788837793.526199:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837793.536837:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837793.536941:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012842624 00000100:00100000:1.0:1788837793.536952:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012842624 00000100:00100000:1.0:1788837793.537029:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 258 00000100:00100000:1.0:1788837793.537040:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+22:2392:x1875732012842624:12345-192.168.201.3@tcp:39:umount.0 00000020:00000080:1.0:1788837793.537074:0:6526:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeef9c 00000020:00010000:1.0:1788837793.537113:0:6526:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8899c322e800: total 0 00000100:00080000:1.0:1788837793.537119:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8899c322a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837793.537148:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1788837793.537317:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3a879e24-3b2f-4404-84c2-9101689d9315+21:2392:x1875732012842624:12345-192.168.201.3@tcp:39:umount.0 Request processed in 279us (490us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788837793.537324:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 258 00000020:00010000:0.0:1788837793.537838:0:6513:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8899c322e800: total 0 00010000:00010000:0.0:1788837793.537900:0:6513:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8899c322e800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788837793.537934:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:0.0:1788837793.537938:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837793.537947:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9aa00/0x57f6d4e926af0027 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edcb expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.537966:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:0.0:1788837793.537969:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788837793.537973:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9200/0x57f6d4e926af0051 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edd9 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.538016:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:0.0:1788837793.538018:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788837793.538021:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8e00/0x57f6d4e926aef33f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea3d expref: 18 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.538030:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889af8da5c00) 00010000:00010000:0.0:1788837793.538031:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837793.538033:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9ac00/0x57f6d4e926aefa00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec19 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.538041:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:0.0:1788837793.538042:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837793.538044:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1325c00/0x57f6d4e926aef958 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebe8 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.538051:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:0.0:1788837793.538053:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788837793.538055:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8200/0x57f6d4e926aefd09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ecf9 expref: 15 pid: 14627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.538061:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff889b01a1fd00) 00010000:00010000:0.0:1788837793.538062:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788837793.538064:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9600/0x57f6d4e926aef63a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eb16 expref: 14 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.538074:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889aded2c400) 00010000:00010000:0.0:1788837793.538076:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837793.538083:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790600/0x57f6d4e926aef2e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea28 expref: 13 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.538104:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889b01a1f300) 00010000:00010000:0.0:1788837793.538106:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837793.538108:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17800/0x57f6d4e926aeff47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ed93 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.538119:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:0.0:1788837793.538120:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788837793.538122:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac0031400/0x57f6d4e926aef982 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebf6 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.538129:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889aded2ce00) 00010000:00010000:0.0:1788837793.538131:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837793.538133:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac1324c00/0x57f6d4e926aef878 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ebb0 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.538140:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff889aded2ca00) 00010000:00010000:0.0:1788837793.538141:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837793.538143:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa790a00/0x57f6d4e926aef2c8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea21 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.538151:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff889b01a1fe00) 00010000:00010000:0.0:1788837793.538153:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788837793.538155:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926aefa1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ec20 expref: 8 pid: 9317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837793.538162:0:6513:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8899c322e800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788837793.538177:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837793.538178:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837793.538179:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837793.549569:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837793.549667:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012842752 00000100:00100000:2.0:1788837793.549678:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012842752 00000100:00100000:2.0:1788837793.549765:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 259 00000100:00100000:2.0:1788837793.549818:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+5:2392:x1875732012842752:12345-192.168.201.3@tcp:39:umount.0 00000020:00000080:2.0:1788837793.549852:0:9317:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeefa3 00000100:00080000:2.0:1788837793.549869:0:9317:0:(import.c:65:import_set_state_nolock()) ffff8899c321f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788837793.549905:0:9317:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788837793.550073:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3a879e24-3b2f-4404-84c2-9101689d9315+3:2392:x1875732012842752:12345-192.168.201.3@tcp:39:umount.0 Request processed in 298us (513us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788837793.550082:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 259 00010000:00010000:1.0:1788837793.550293:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788837793.550339:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788837793.721039:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837793.721065:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037000192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837793.721134:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837793.721629:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037000192 00000100:00100000:1.0:1788837793.721638:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037000192 00000100:00100000:1.0:1788837793.721700:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788837793.721794:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037000192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837793.721827:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788837793.721895:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837793.722030:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037000192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 321us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837793.722037:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788837793.722079:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037000192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837793.722770:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837793.722805:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037000320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837793.722852:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837793.722904:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732037000448:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.722951:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837793.722986:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037000448 00000100:00100000:2.0:1788837793.722990:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037000448 00000100:00100000:2.0:1788837793.723027:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788837793.723034:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732037000448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.723084:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732037000448:12345-0@lo:400:kworker.0 Request processed in 50us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.723091:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788837793.723122:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037000320 00000100:00100000:2.0:1788837793.723126:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037000320 00000100:00100000:2.0:1788837793.723157:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788837793.723164:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037000320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837793.723175:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837793.723203:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037000320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.723208:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1788837793.723222:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837793.723239:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732037000448:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.723254:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037000320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837793.723500:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037000704:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.723543:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837793.723565:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732037001216:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.723594:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837793.723598:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037000960:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.723617:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732037001728:0@lo:400:kworker.0 00000100:00100000:1.0:1788837793.723633:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837793.723657:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037001472:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.723663:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837793.723698:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837793.723700:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788837793.723708:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037000576:0@lo:400:kworker.0 00000100:00100000:3.0:1788837793.724579:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037000704 00000100:00100000:3.0:1788837793.724588:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037000704 00000100:00100000:0.0:1788837793.725420:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037001216 00000100:00100000:0.0:1788837793.725425:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037001216 00000100:00100000:0.0:1788837793.725474:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037001728 00000100:00100000:0.0:1788837793.725478:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037001728 00000100:00100000:0.0:1788837793.725504:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788837793.725513:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732037001216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.725764:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837793.725815:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037001088:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.725843:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837793.725856:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732037001600:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.725876:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837793.725901:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037000576 00000100:00100000:2.0:1788837793.725905:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037000576 00000100:00100000:2.0:1788837793.725923:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037001088 00000100:00100000:2.0:1788837793.725926:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037001088 00000100:00100000:2.0:1788837793.725937:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037001600 00000100:00100000:2.0:1788837793.725939:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037001600 00000100:00100000:2.0:1788837793.725953:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788837793.725959:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732037001728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.725997:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732037001728:12345-0@lo:400:kworker.0 Request processed in 37us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.726004:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788837793.726021:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788837793.726027:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037000576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.726071:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037000576:12345-0@lo:400:kworker.0 Request processed in 30us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.726077:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788837793.726090:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788837793.726097:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732037001088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.726126:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732037001088:12345-0@lo:400:kworker.0 Request processed in 30us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.726147:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788837793.726161:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788837793.726167:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732037001600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.726197:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875732037001600:12345-0@lo:400:kworker.0 Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.726203:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:2.0:1788837793.726218:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837793.726222:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837793.726251:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037000576:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.726262:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037001088:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.726270:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732037001600:0@lo:400:kworker.0 00010000:00080000:2.0:1788837793.726281:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889afa5f0700 x1875732037001728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837793.726292:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732037001728:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.726330:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037000832:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.726355:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837793.726373:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037001344:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.726394:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837793.726425:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037001856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837793.726449:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837793.726477:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037000832 00000100:00100000:2.0:1788837793.726481:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037000832 00000100:00100000:2.0:1788837793.726514:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788837793.726538:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037000832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.726574:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037000832:12345-0@lo:400:kworker.0 Request processed in 47us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.726581:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788837793.726606:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037000832:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.726632:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037001472 00000100:00100000:2.0:1788837793.726636:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037001472 00000100:00100000:2.0:1788837793.726659:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037001344 00000100:00100000:2.0:1788837793.726662:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037001344 00000100:00100000:2.0:1788837793.726678:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788837793.726684:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037001472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.726714:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037001472:12345-0@lo:400:kworker.0 Request processed in 31us (3018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.726719:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788837793.726728:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788837793.726733:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037001344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.726757:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037001344:12345-0@lo:400:kworker.0 Request processed in 25us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.726763:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788837793.726809:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037001344:0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.726835:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037000960 00000100:00100000:2.0:1788837793.726839:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037000960 00000100:00100000:2.0:1788837793.726859:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037001856 00000100:00100000:2.0:1788837793.726861:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037001856 00000100:00100000:2.0:1788837793.726872:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788837793.726892:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875732037000960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837793.726934:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875732037000960:12345-0@lo:400:kworker.0 Request processed in 43us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.726941:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788837793.726952:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788837793.726958:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037001856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788837793.726979:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788837793.727015:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037001856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837793.727021:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788837793.727050:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037001856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837793.728630:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788837793.728642:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037000704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837793.728754:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037000704:12345-0@lo:400:kworker.0 Request processed in 114us (5211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837793.728760:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788837793.728830:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037000704:0@lo:400:kworker.0 00000100:00100000:1.0:1788837793.729168:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037001472:0@lo:400:kworker.0 00000100:00100000:1.0:1788837793.729195:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037000960:0@lo:400:kworker.0 00000100:00100000:0.0:1788837793.729481:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732037001216:12345-0@lo:400:kworker.0 Request processed in 3967us (5884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837793.729491:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00010000:00080000:2.0:1788837793.729557:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c27be680 x1875732037001216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837793.729568:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732037001216:0@lo:400:kworker.0 00010000:00010000:0.0:1788837794.489035:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837794.748558:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037001984:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837794.748628:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837794.748772:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037001984 00000100:00100000:2.0:1788837794.748800:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037001984 00000100:00100000:2.0:1788837794.748855:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788837794.748864:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037001984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788837794.748906:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788837794.748965:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037001984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837794.748972:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788837794.749472:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037001984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837794.802753:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837794.802818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837794.802856:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837794.802884:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012843136 00000100:00100000:3.0:1788837794.802893:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012843136 00000100:00100000:0.0:1788837794.802902:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012843008 00000100:00100000:0.0:1788837794.802909:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012843008 00000100:00100000:1.0:1788837794.802995:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012842880 00000100:00100000:1.0:1788837794.803000:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012842880 00000100:00100000:1.0:1788837794.803035:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 393 00000100:00100000:1.0:1788837794.803045:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac5eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2395:x1875732012842880:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837794.803110:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac5eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2395:x1875732012842880:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 66us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837794.803116:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 393 00000100:00100000:3.0:1788837794.803281:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 345 00000100:00100000:3.0:1788837794.803290:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012843136:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837794.803382:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2395:x1875732012843136:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 92us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837794.803389:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 345 00000100:00100000:3.0:1788837794.803403:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 346 00000100:00100000:3.0:1788837794.803424:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:2395:x1875732012843008:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837794.803452:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:2395:x1875732012843008:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 28us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837794.803458:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 346 00000100:00080000:0.0:1788837794.807146:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837794.807158:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837795.032989:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837795.033099:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837795.033387:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837795.033589:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012843264 00000100:00100000:0.0:1788837795.033599:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012843264 00000100:00100000:0.0:1788837795.033732:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012843392 00000100:00100000:0.0:1788837795.033736:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012843392 00000100:00100000:3.0:1788837795.034086:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837795.034269:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012843520 00000100:00100000:1.0:1788837795.034274:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012843520 00000100:00100000:1.0:1788837795.034301:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:1.0:1788837795.034309:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+12:2393:x1875732012843264:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837795.034325:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837795.034346:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c8400/0x57f6d4e926aef09f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e94f expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837795.034362:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837795.034413:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+11:2393:x1875732012843264:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 104us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837795.034420:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:1.0:1788837795.034437:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:1.0:1788837795.034443:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+10:2393:x1875732012843392:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837795.034451:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837795.034459:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b16000/0x57f6d4e926aef0a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e980 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837795.034468:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837795.034496:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+9:2393:x1875732012843392:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 53us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837795.034503:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:1.0:1788837795.034552:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:1.0:1788837795.034559:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+8:2394:x1875732012843520:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837795.034567:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837795.034585:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac0030600/0x57f6d4e926aef25f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ea0c expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837795.034595:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837795.034613:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+7:2394:x1875732012843520:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 55us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837795.034618:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:1.0:1788837795.034722:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012843776 00000100:00100000:1.0:1788837795.034727:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012843776 00000100:00100000:1.0:1788837795.034754:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 260 00000100:00100000:1.0:1788837795.034761:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+6:2392:x1875732012843776:12345-192.168.201.3@tcp:39:umount.0 00000020:00000080:1.0:1788837795.034820:0:14627:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aef0b4 00000020:00010000:1.0:1788837795.034828:0:14627:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8899c3645000: total 0 00000100:00080000:1.0:1788837795.034832:0:14627:0:(import.c:65:import_set_state_nolock()) ffff8899c3642000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837795.034853:0:14627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:1.0:1788837795.034977:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2392:x1875732012843776:12345-192.168.201.3@tcp:39:umount.0 Request processed in 216us (891us total) trans 4294967529 rc 0/0 00000100:00100000:1.0:1788837795.034984:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 260 00000020:00010000:1.0:1788837795.035050:0:6513:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8899c3645000: total 0 00010000:00010000:1.0:1788837795.035054:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837795.035095:0:6513:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8899c3645000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788837795.035126:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889af8da5c00) 00010000:00010000:1.0:1788837795.035130:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837795.035136:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a000/0x57f6d4e926af0074 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ede7 expref: 4 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837795.035156:0:6513:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8899c3645000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788837795.035167:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837795.035168:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837795.035170:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837795.046323:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837795.046549:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012843904 00000100:00100000:1.0:1788837795.046560:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012843904 00000100:00100000:1.0:1788837795.046631:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 261 00000100:00100000:1.0:1788837795.046641:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+5:2392:x1875732012843904:12345-192.168.201.3@tcp:39:umount.0 00000020:00000080:1.0:1788837795.046680:0:6524:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aef0bb 00000100:00080000:1.0:1788837795.046690:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8899c2478000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837795.047104:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788837795.047258:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2b39e4b-b1a1-4fb5-8aed-db8a043c6108+3:2392:x1875732012843904:12345-192.168.201.3@tcp:39:umount.0 Request processed in 617us (941us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788837795.047267:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 261 00010000:00010000:2.0:1788837795.047367:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837795.069388:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837795.069485:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012844160 00000100:00100000:2.0:1788837795.069496:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012844160 00000100:00100000:2.0:1788837795.069558:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 394 00000100:00100000:2.0:1788837795.069587:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+7:2392:x1875732012844160:12345-192.168.201.3@tcp:251:umount.0 00000020:00000080:2.0:1788837795.069629:0:6519:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeef79 00000020:00010000:2.0:1788837795.069636:0:6519:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8899c3641000: total 0 00000100:00080000:2.0:1788837795.069640:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8899c3642800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788837795.069710:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4c32a019-8b58-4c01-ad5a-2d6d487440e1+3:2392:x1875732012844160:12345-192.168.201.3@tcp:251:umount.0 Request processed in 124us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837795.069718:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 394 00000020:00010000:0.0:1788837795.070007:0:6512:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8899c3641000: total 0 00010000:00010000:0.0:1788837795.070066:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8899c3641000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788837795.070100:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa790c00/0x57f6d4e926aeefd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003e941 expref: 2 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837795.070127:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8899c3641000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788837795.070140:0:6512:0:(genops.c:885:class_export_put()) final put ffff8899c3641000/4c32a019-8b58-4c01-ad5a-2d6d487440e1 00010000:00010000:0.0:1788837795.070158:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837795.070160:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837795.070162:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788837795.070184:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3641000/4c32a019-8b58-4c01-ad5a-2d6d487440e1 for MGS 00000020:00000080:3.0:1788837795.074876:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c3642800 for MGS 00010000:00010000:0.0:1788837795.513031:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837796.537953:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788837797.137620:0:15212:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788837797.152977:0:15212:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788837797.153040:0:15212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837797.153056:0:15212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837797.153063:0:15212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837797.153071:0:15212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837797.153094:0:15212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788837797.153099:0:15212:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788837797.153125:0:15212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788837797.153130:0:15212:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788837797.153136:0:15212:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788837797.153161:0:15212:0:(import.c:65:import_set_state_nolock()) ffff889ae7d3f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788837797.153198:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732037002112:0@lo:39:umount.0 00000100:00100000:1.0:1788837797.153266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837797.153534:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037002112 00000100:00100000:0.0:1788837797.153543:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037002112 00000100:00100000:0.0:1788837797.153611:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00010000:00010000:3.0:1788837797.153612:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837797.153619:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.153627:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dbe00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837797.153631:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.153640:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837797.153642:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875732037002112:12345-0@lo:39:umount.0 10000000:00010000:3.0:1788837797.153648:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837797.153653:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788837797.153655:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788837797.153657:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000020:00000080:0.0:1788837797.153665:0:6526:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeb90 00000100:00080000:0.0:1788837797.153674:0:6526:0:(import.c:65:import_set_state_nolock()) ffff889ae7f50800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788837797.153696:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.153708:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837797.153726:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837797.153730:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1875732037002112:12345-0@lo:39:umount.0 Request processed in 89us (464us total) trans 0 rc 0/0 00010000:00010000:3.0:1788837797.153733:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6dbe00/0x57f6d4e926aef060 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef067 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837797.153737:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00010000:00010000:3.0:1788837797.153744:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837797.153746:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788837797.153746:0:6526:0:(genops.c:885:class_export_put()) final put ffff889ac85f4000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788837797.153747:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837797.153757:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732037002240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837797.153773:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837797.153806:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788837797.153888:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac85f4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788837797.153939:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889ae7f50800 for lustre-MDT0000 00000100:00100000:0.0:1788837797.154190:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037002240 00000100:00100000:0.0:1788837797.154195:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037002240 00000100:00100000:0.0:1788837797.154236:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837797.154244:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3648:x1875732037002240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837797.154254:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837797.154269:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b17400/0x57f6d4e926aef067 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aef060 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837797.154281:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837797.154313:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:3648:x1875732037002240:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837797.154320:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788837797.154335:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732037002240:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788837797.155156:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ae7d3f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788837797.155180:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732037002112:0@lo:39:umount.0 00000100:00080000:3.0:1788837797.155504:0:15212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788837797.155508:0:15212:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788837797.155512:0:15212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788837797.156364:0:15212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156378:0:15212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156384:0:15212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156390:0:15212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156432:0:15212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837797.156438:0:15212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156445:0:15212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156450:0:15212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156455:0:15212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156481:0:15212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788837797.156494:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837797.156499:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156506:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dac00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837797.156510:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156518:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837797.156525:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837797.156531:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788837797.156539:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788837797.156552:0:10392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837797.156557:0:10392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837797.156564:0:10392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0031a00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837797.156566:0:10392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156567:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156573:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837797.156577:0:10392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837797.156583:0:10392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837797.156588:0:10392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788837797.156590:0:10392:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788837797.156591:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837797.156592:0:10392:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788837797.156597:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6dac00/0x57f6d4e926aef06e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef075 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156609:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837797.156611:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837797.156613:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837797.156617:0:10392:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837797.156622:0:10392:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788837797.156628:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732037002368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837797.156652:0:10392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837797.156666:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac0031a00/0x57f6d4e926aeef33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aeef3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837797.156675:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837797.156677:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837797.156678:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837797.156685:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837797.156686:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837797.156696:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732037002496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837797.156719:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788837797.156738:0:15212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837797.156743:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037002368 00010000:00010000:3.0:1788837797.156746:0:15212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837797.156748:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037002368 00010000:00010000:3.0:1788837797.156752:0:15212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156758:0:15212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156769:0:15212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837797.156799:0:15212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031c00/0x57f6d4e926aeeaef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837797.156806:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037002496 00000100:00100000:0.0:1788837797.156809:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037002496 00010000:00010000:3.0:1788837797.156812:0:15212:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031c00/0x57f6d4e926aeeaef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156818:0:15212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031c00/0x57f6d4e926aeeaef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156824:0:15212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889ac0031c00/0x57f6d4e926aeeaef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156835:0:15212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788837797.156838:0:15212:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788837797.156840:0:15212:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:0.0:1788837797.156840:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788837797.156853:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3649:x1875732037002368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837797.156866:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837797.156866:0:9528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837797.156869:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156874:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0030200 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837797.156877:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837797.156878:0:9528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa791a00/0x57f6d4e926aef075 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aef06e expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156885:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837797.156891:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837797.156896:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788837797.156898:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788837797.156899:0:9528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:3.0:1788837797.156900:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788837797.156917:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156923:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837797.156932:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156938:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac0030200/0x57f6d4e926aef297 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef29e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837797.156940:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:3649:x1875732037002368:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837797.156948:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788837797.156949:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837797.156952:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac0031c00/0x57f6d4e926aeeaef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156957:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0031c00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837797.156959:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac0031c00/0x57f6d4e926aeeaef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156966:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac0031c00/0x57f6d4e926aeeaef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837797.156972:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac0031c00/0x57f6d4e926aeeaef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837797.156977:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788837797.156979:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788837797.156980:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788837797.156991:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac0031c00/0x57f6d4e926aeeaef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.156997:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837797.157007:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac0031c00/0x57f6d4e926aeeaef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.157019:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac0031c00/0x57f6d4e926aeeaef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aeeaf6 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837797.157028:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837797.157029:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837797.157031:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837797.157040:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732037002752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837797.157066:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837797.159438:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837797.159465:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732037002624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837797.159563:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788837797.168368:0:15212:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788837797.168375:0:15212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788837797.168381:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837797.168387:0:15212:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788837797.168396:0:15212:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8899c27c6000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788837797.168403:0:15212:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8899c21e4000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788837797.168407:0:15212:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff889b01bb0800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788837797.168412:0:15212:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff889ae7ed2800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1788837797.168419:0:15212:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8899c3645000 e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 192.168.201.3@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788837797.168424:0:15212:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8899c322e800 3a879e24-3b2f-4404-84c2-9101689d9315 192.168.201.3@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:3.0:1788837797.168429:0:15212:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff889adeb78000) has exports, disconnecting them 00000020:00080000:3.0:1788837797.168433:0:15212:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8899c27c6000), last request at 1788837793 00000020:00000080:3.0:1788837797.168440:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeea7 00000100:00080000:3.0:1788837797.168459:0:15212:0:(import.c:65:import_set_state_nolock()) ffff8899c27c4000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788837797.168521:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788837797.168536:0:15212:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c27c6000): rc 0 00000020:00000080:3.0:1788837797.168554:0:15212:0:(genops.c:885:class_export_put()) final put ffff8899c27c6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788837797.168565:0:15212:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8899c21e4000), last request at 1788837793 00000020:00000080:3.0:1788837797.168569:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeed7a 00000100:00080000:3.0:1788837797.168575:0:15212:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788837797.168589:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c27c6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788837797.168624:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c27c4000 for lustre-MDT0000 00010000:00010000:3.0:1788837797.168636:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788837797.168644:0:15212:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c21e4000): rc 0 00000020:00000080:3.0:1788837797.168646:0:15212:0:(genops.c:885:class_export_put()) final put ffff8899c21e4000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788837797.168653:0:15212:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff889b01bb0800), last request at 1788837574 00000020:00000080:3.0:1788837797.168657:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeec77 00000100:00080000:3.0:1788837797.168671:0:15212:0:(import.c:65:import_set_state_nolock()) ffff889b01bb6000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788837797.168691:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c21e4000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788837797.168714:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c21e7000 for lustre-MDT0000 00010000:00010000:3.0:1788837797.168722:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788837797.168729:0:15212:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff889b01bb0800): rc 0 00000020:00000080:3.0:1788837797.168731:0:15212:0:(genops.c:885:class_export_put()) final put ffff889b01bb0800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788837797.168738:0:15212:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff889ae7ed2800), last request at 1788837574 00000020:00000080:3.0:1788837797.168741:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeec46 00000100:00080000:3.0:1788837797.168744:0:15212:0:(import.c:65:import_set_state_nolock()) ffff889ae7ed1000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788837797.168752:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889b01bb0800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788837797.168792:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889b01bb6000 for lustre-MDT0000 00010000:00010000:3.0:1788837797.168801:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788837797.168808:0:15212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:3.0:1788837797.168880:0:15212:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff889ae7ed2800): rc 0 00000004:00000080:3.0:1788837797.168886:0:15212:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa3bc81c1fae0 00000100:00080000:3.0:1788837797.168902:0:15212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788837797.168905:0:15212:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1788837797.169105:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037002752 00000100:00100000:0.0:1788837797.169116:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037002752 00000100:00100000:0.0:1788837797.169150:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037002624 00000100:00100000:0.0:1788837797.169153:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037002624 00000100:00100000:0.0:1788837797.169199:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788837797.169209:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+24:3651:x1875732037002496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837797.169223:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837797.169242:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b17000/0x57f6d4e926aeef3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aeef33 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837797.169256:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837797.169319:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+23:3651:x1875732037002496:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (12599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837797.169326:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788837797.169341:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788837797.169347:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+22:3650:x1875732037002624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837797.169354:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837797.169362:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c9800/0x57f6d4e926aef29e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aef297 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837797.169381:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837797.169402:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+21:3650:x1875732037002624:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (9839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837797.169408:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788837797.169424:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837797.169450:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3649:1875732037002368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837797.169494:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732037002496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837797.169537:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788837797.169543:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+20:3648:x1875732037002752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837797.169550:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837797.169557:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889b02044a00/0x57f6d4e926aeeaf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aeeaef expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837797.169566:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837797.169608:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:3648:x1875732037002752:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (12532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837797.169614:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837797.169685:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732037002752:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788837797.169702:0:15212:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788837797.169719:0:15212:0:(import.c:65:import_set_state_nolock()) ffff889afa557800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788837797.170793:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037002880:0@lo:39:umount.0 00000100:00100000:0.0:1788837797.171255:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837797.171309:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037002880 00000100:00100000:0.0:1788837797.171316:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037002880 00000100:00100000:0.0:1788837797.171353:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788837797.171360:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875732037002880:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788837797.171385:0:6529:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeecd2 00000100:00080000:0.0:1788837797.171392:0:6529:0:(import.c:65:import_set_state_nolock()) ffff889ac4425000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837797.171419:0:6529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788837797.171551:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3647:x1875732037002880:12345-0@lo:39:umount.0 Request processed in 190us (297us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788837797.171558:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00010000:00010000:0.0:1788837797.171581:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788837797.171619:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889afa557800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788837797.171633:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037002880:0@lo:39:umount.0 00000100:00100000:2.0:1788837797.175561:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732037002624:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788837797.176165:0:15212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788837797.176170:0:15212:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1788837797.176184:0:15212:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788837797.176251:0:15212:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788837797.176274:0:15212:0:(import.c:65:import_set_state_nolock()) ffff889affb4b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788837797.176328:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037003008:0@lo:9:umount.0 00000100:00100000:1.0:1788837797.176392:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837797.176464:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037003008 00000100:00100000:2.0:1788837797.176480:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037003008 00000100:00100000:2.0:1788837797.176532:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788837797.176541:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875732037003008:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788837797.176563:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeee22 00000100:00080000:2.0:1788837797.176572:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8899c1b24000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788837797.176611:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:0.0:1788837797.177770:0:15212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788837797.177788:0:15212:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1788837797.177800:0:15212:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788837797.177852:0:15212:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788837797.177869:0:15212:0:(import.c:65:import_set_state_nolock()) ffff8899c322b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788837797.178525:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037003136:0@lo:9:umount.0 00000100:00100000:1.0:1788837797.178564:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788837797.182846:0:15212:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff889adeb78000) has no exports 00000100:00100000:2.0:1788837797.184187:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3647:x1875732037003008:12345-0@lo:9:umount.0 Request processed in 7640us (7788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837797.184200:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788837797.184227:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037003136 00000100:00100000:2.0:1788837797.184235:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037003136 00000100:00080000:1.0:1788837797.185520:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889affb4b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788837797.185554:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788837797.185557:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788837797.185562:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037003008:0@lo:9:umount.0 00000100:00100000:2.0:1788837797.186558:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788837797.186570:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875732037003136:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788837797.186598:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeef64 00000100:00080000:2.0:1788837797.186617:0:8439:0:(import.c:65:import_set_state_nolock()) ffff8899c321a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788837797.186811:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788837797.186966:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3647:x1875732037003136:12345-0@lo:9:umount.0 Request processed in 397us (8400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837797.186975:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788837797.186998:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837797.187001:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788837797.187013:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837797.187026:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788837797.189988:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c322b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788837797.190014:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788837797.190017:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788837797.190023:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037003136:0@lo:9:umount.0 00000020:00080000:2.0:1788837797.203491:0:15212:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff889adeb78000) has no exports 00000020:00000080:2.0:1788837797.263272:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeb4a 00000020:00000080:2.0:1788837797.263289:0:15212:0:(genops.c:885:class_export_put()) final put ffff889ae7d39800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788837797.263359:0:15212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788837797.263450:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7d39800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788837797.263490:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837797.263501:0:15212:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788837797.263505:0:15212:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff889ac84899b8) has no exports 00000020:00000080:3.0:1788837797.265579:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeb43 00000020:00000080:3.0:1788837797.265590:0:15212:0:(genops.c:885:class_export_put()) final put ffff889ae7ced000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788837797.266227:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7ced000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788837797.266316:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837797.266326:0:15212:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788837797.266330:0:15212:0:(genops.c:885:class_export_put()) final put ffff889ac409b000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788837797.266332:0:15212:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac409b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788837797.266336:0:15212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:3.0:1788837797.305143:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837797.305167:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037003264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837797.305238:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837797.306831:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037003264 00000100:00100000:2.0:1788837797.306842:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037003264 00000100:00100000:2.0:1788837797.306929:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788837797.306939:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037003264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837797.306971:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788837797.307036:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037003264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837797.307043:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788837797.307249:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037003264:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788837797.307322:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837797.561938:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788837798.331172:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788837798.331181:0:6503:0:(genops.c:885:class_export_put()) final put ffff889ae7ed2800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788837798.331205:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 00000001:00080000:0.0:1788837798.331214:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:0.0:1788837798.331218:0:6503:0:(genops.c:885:class_export_put()) final put ffff8899c3645000/e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 00000001:00100000:0.0:1788837798.331224:0:6503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3a879e24-3b2f-4404-84c2-9101689d9315 00000001:00080000:0.0:1788837798.331228:0:6503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1788837798.331235:0:6503:0:(genops.c:885:class_export_put()) final put ffff8899c322e800/3a879e24-3b2f-4404-84c2-9101689d9315 00000020:00000080:2.0:1788837798.331264:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7ed2800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788837798.331896:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3645000/e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 for lustre-MDT0000 00000020:00000080:2.0:1788837798.332106:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c322e800/3a879e24-3b2f-4404-84c2-9101689d9315 for lustre-MDT0000 00000020:00000080:2.0:1788837798.332410:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889ae7ed1000 for lustre-MDT0000 00000020:00000080:2.0:1788837798.332416:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c3642000 for lustre-MDT0000 00000020:00000080:2.0:1788837798.332420:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c322a800 for lustre-MDT0000 00010000:00010000:2.0:1788837798.585077:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837798.841814:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732037003392:0@lo:400:kworker.0 00000100:00100000:2.0:1788837798.842099:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037003520:0@lo:400:kworker.0 00000100:00100000:2.0:1788837798.842134:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.842184:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037004032:0@lo:400:kworker.0 00000100:00100000:2.0:1788837798.842202:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837798.842213:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037003776:0@lo:400:kworker.0 00000100:00100000:2.0:1788837798.842232:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037004544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837798.842255:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.842262:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837798.842293:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732037004288:0@lo:400:kworker.0 00000100:00100000:2.0:1788837798.842310:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037004032 00000100:00100000:2.0:1788837798.842316:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037004032 00000100:00100000:1.0:1788837798.842322:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837798.842346:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788837798.842354:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732037003648:0@lo:400:kworker.0 00000100:00100000:2.0:1788837798.842370:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788837798.842384:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.842385:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037004032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837798.842403:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732037004160:0@lo:400:kworker.0 00000100:00100000:1.0:1788837798.842437:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837798.842459:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037004032:12345-0@lo:400:kworker.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837798.842468:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788837798.842521:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037004032:0@lo:400:kworker.0 00000100:00100000:2.0:1788837798.842551:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037004544 00000100:00100000:2.0:1788837798.842554:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037004544 00000100:00100000:1.0:1788837798.842576:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037003776 00000100:00100000:1.0:1788837798.842582:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037003776 00000100:00100000:2.0:1788837798.842594:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788837798.842602:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037004544:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837798.842610:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037004288 00000100:00100000:1.0:1788837798.842614:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037004288 00002000:00000024:2.0:1788837798.842624:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837798.842646:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037003648 00000100:00100000:1.0:1788837798.842651:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037003648 00000100:00100000:1.0:1788837798.842663:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037004160 00000100:00100000:2.0:1788837798.842664:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037004544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837798.842666:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037004160 00000100:00100000:2.0:1788837798.842675:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788837798.842682:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788837798.842691:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732037004288:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788837798.842696:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837798.842702:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837798.842725:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037004544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837798.842740:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732037004288:12345-0@lo:400:kworker.0 Request processed in 50us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837798.842758:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788837798.842764:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788837798.842927:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837798.843112:0:7894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037003520 00000100:00100000:3.0:1788837798.843117:0:7894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037003520 00000100:00100000:3.0:1788837798.843143:0:7894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788837798.843149:0:7894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1875732037003520:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788837798.843155:0:7894:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788837798.843194:0:7894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1875732037003520:12345-0@lo:400:kworker.0 Request processed in 45us (1060us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788837798.843200:0:7894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788837798.843248:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037003904:0@lo:400:kworker.0 00000100:00100000:0.0:1788837798.843273:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837798.843283:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037004416:0@lo:400:kworker.0 00000100:00100000:0.0:1788837798.843303:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837798.843333:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037003904 00000100:00100000:0.0:1788837798.843337:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037003904 00000100:00100000:2.0:1788837798.843490:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875732037003776:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788837798.843497:0:6524:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788837798.843528:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875732037003776:12345-0@lo:400:kworker.0 Request processed in 39us (1273us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788837798.849967:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788837798.849981:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875732037003648:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788837798.849992:0:6525:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788837798.850006:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788837798.850016:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875732037004160:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788837798.850039:0:9317:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788837798.850072:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037003392 00000100:00100000:1.0:1788837798.850081:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037003392 00000100:00100000:3.0:1788837798.850120:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875732037004160:12345-0@lo:400:kworker.0 Request processed in 103us (7682us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788837798.850129:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788837798.850134:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788837798.850164:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad6214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:3650:x1875732037003392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837798.850232:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad6214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b603ecff-2147-4e64-a76e-e3f6861ab0fb+19:3650:x1875732037003392:12345-0@lo:400:kworker.0 Request processed in 88us (7302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837798.850241:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00080000:1.0:1788837798.850362:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788837798.850367:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8899c3247800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788837798.850371:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788837798.850475:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788837798.850480:0:3651:0:(import.c:65:import_set_state_nolock()) ffff889ae7f56000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788837798.850484:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788837798.850490:0:3651:0:(import.c:65:import_set_state_nolock()) ffff889ae7f56000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837798.850508:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 191 00000100:00080000:3.0:1788837798.850515:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff889ae7f56000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837798.850562:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ad17ae300 x1875732037004672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837798.850620:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037003520:0@lo:400:kworker.0 00000100:00100000:3.0:1788837798.850754:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037004416 00000100:00100000:3.0:1788837798.850758:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037004416 00000100:00100000:3.0:1788837798.850911:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788837798.850917:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037004416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837798.850968:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037004416:12345-0@lo:400:kworker.0 Request processed in 52us (7664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837798.850973:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1788837798.851011:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837798.851038:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3650:1875732037003392:0@lo:400:kworker.0 00000100:00100000:3.0:1788837798.851102:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037004416:0@lo:400:kworker.0 00000001:00100000:3.0:1788837798.851138:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788837798.851154:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1788837798.851157:0:7456:0:(genops.c:885:class_export_put()) final put ffff889aec399000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788837798.851172:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 00000001:00080000:3.0:1788837798.851177:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1788837798.851179:0:7456:0:(genops.c:885:class_export_put()) final put ffff8899c247f800/e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 00000001:00100000:3.0:1788837798.851183:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3a879e24-3b2f-4404-84c2-9101689d9315 00000001:00080000:3.0:1788837798.851188:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1788837798.851190:0:7456:0:(genops.c:885:class_export_put()) final put ffff8899c321c800/3a879e24-3b2f-4404-84c2-9101689d9315 00000100:00100000:0.0:1788837798.851287:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788837798.851294:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875732037003648:12345-0@lo:400:kworker.0 Request processed in 1313us (8913us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788837798.851302:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037003904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837798.851307:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788837798.851335:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037004672:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788837798.851353:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037003904:12345-0@lo:400:kworker.0 Request processed in 57us (8078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837798.851360:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000001:00100000:3.0:1788837798.851555:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788837798.851559:0:9519:0:(genops.c:885:class_export_put()) final put ffff8899c321d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788837798.851568:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3a879e24-3b2f-4404-84c2-9101689d9315 00000020:00000080:3.0:1788837798.851570:0:9519:0:(genops.c:885:class_export_put()) final put ffff8899c356b000/3a879e24-3b2f-4404-84c2-9101689d9315 00010000:00080000:0.0:1788837798.853620:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3d40700 x1875732037003904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837798.853647:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037003904:0@lo:400:kworker.0 00000100:00100000:3.0:1788837798.853684:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837798.853762:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037004672 00000100:00100000:3.0:1788837798.853769:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037004672 00000020:00000080:0.0:1788837798.853803:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889aec399000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788837798.853860:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c247f800/e2b39e4b-b1a1-4fb5-8aed-db8a043c6108 for lustre-MDT0001 00000020:00000080:0.0:1788837798.853884:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c321c800/3a879e24-3b2f-4404-84c2-9101689d9315 for lustre-MDT0001 00000100:00100000:3.0:1788837798.853889:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788837798.853899:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875732037004672:12345-0@lo:38:ptlrpcd_00_03.0 00000020:00000080:0.0:1788837798.853915:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c321d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00010000:02000000:3.0:1788837798.853918:0:6530:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000020:00000080:0.0:1788837798.853935:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c356b000/3a879e24-3b2f-4404-84c2-9101689d9315 for lustre-OST0001 00000020:00000080:0.0:1788837798.853957:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889ac4425000 for lustre-MDT0001 00000020:00000080:0.0:1788837798.853966:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c2478000 for lustre-MDT0001 00000020:00000080:0.0:1788837798.853971:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c321f800 for lustre-MDT0001 00000020:00000080:0.0:1788837798.853975:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c321a000 for lustre-OST0001 00000100:00100000:2.0:1788837798.853983:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000020:00000080:0.0:1788837798.853994:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c356a000 for lustre-OST0001 00000100:00080000:1.0:1788837798.876578:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8899c3247800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837798.876589:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 233 00000100:00080000:1.0:1788837798.876600:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8899c3247800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837798.877596:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afa5f1880 x1875732037004800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837798.877627:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875732037004160:0@lo:400:kworker.0 00000001:00100000:0.0:1788837798.877929:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788837798.877935:0:8433:0:(genops.c:885:class_export_put()) final put ffff8899c1b21000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788837798.877954:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3a879e24-3b2f-4404-84c2-9101689d9315 00000020:00000080:0.0:1788837798.877956:0:8433:0:(genops.c:885:class_export_put()) final put ffff8899c3568000/3a879e24-3b2f-4404-84c2-9101689d9315 00000100:00100000:0.0:1788837798.877995:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037004800:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788837798.878061:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837798.878118:0:14627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037004800 00000100:00100000:0.0:1788837798.878124:0:14627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037004800 00000100:00100000:0.0:1788837798.878156:0:14627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788837798.878163:0:14627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875732037004800:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788837798.878179:0:14627:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788837798.878216:0:14627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875732037004800:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 53us (155us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788837798.878223:0:14627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1788837798.878257:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c3247800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837798.878262:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788837798.878265:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037004800:0@lo:38:ptlrpcd_00_01.0 00000020:00000080:2.0:1788837798.878449:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c1b21000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788837798.878495:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3568000/3a879e24-3b2f-4404-84c2-9101689d9315 for lustre-OST0000 00000020:00000080:2.0:1788837798.878517:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c1b24000 for lustre-OST0000 00000020:00000080:2.0:1788837798.878521:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c356f800 for lustre-OST0000 00000100:00080000:0.0:1788837798.878837:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788837798.878841:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8899c21e0800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788837798.878845:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788837798.878849:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8899c21e0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837798.878852:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 212 00000100:00080000:0.0:1788837798.878858:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8899c21e0800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788837798.878875:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c44c8700 x1875732037004928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837798.878912:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037003776:0@lo:400:kworker.0 00010000:00080000:0.0:1788837798.878928:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3d43800 x1875732037004288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837798.878939:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732037004288:0@lo:400:kworker.0 00000100:00080000:0.0:1788837798.878964:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788837798.878967:0:3649:0:(import.c:65:import_set_state_nolock()) ffff889b01bb2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788837798.878970:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788837798.878973:0:3649:0:(import.c:65:import_set_state_nolock()) ffff889b01bb2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837798.878977:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 191 00000100:00080000:0.0:1788837798.878980:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff889b01bb2800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788837798.878993:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c44ca300 x1875732037005056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837798.879003:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732037003648:0@lo:400:kworker.0 00000100:00100000:1.0:1788837798.879318:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875732037004928:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788837798.879358:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837798.879395:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875732037005056:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788837798.879425:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837798.879500:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037004928 00000100:00100000:0.0:1788837798.879505:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037004928 00000100:00100000:0.0:1788837798.879543:0:9317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037005056 00000100:00100000:0.0:1788837798.879546:0:9317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037005056 00000100:00100000:0.0:1788837798.879564:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788837798.879569:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875732037004928:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788837798.879579:0:9317:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788837798.879613:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875732037004928:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 43us (255us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788837798.879621:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788837798.879641:0:9317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788837798.879657:0:9317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875732037005056:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788837798.879666:0:9317:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788837798.879691:0:9317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875732037005056:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 45us (266us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788837798.879698:0:9317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1788837798.879726:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c21e0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837798.879731:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788837798.879734:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875732037004928:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1788837798.879743:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889b01bb2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837798.879746:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788837798.879748:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875732037005056:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788837798.891254:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875732037004672:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 37344us (37560us total) trans 0 rc -19/-19 00000100:00080000:0.0:1788837798.891370:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ae7f56000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837798.891377:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788837798.891381:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037004672:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788837798.891486:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000020:01000000:0.0:1788837799.289339:0:15212:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889ac44179c0 - data ffff889ae534eaf8/ffff889afa779c00 00000020:01000000:0.0:1788837799.289843:0:15212:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889ac88e4540 - data ffff889ae5180438/ffff889ad042dc00 00000001:00000004:0.0:1788837799.303194:0:15212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:3.0:1788837799.350587:0:15212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788837799.350596:0:15212:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788837799.350612:0:15212:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8899c4491500 x1875732037002880/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788837807 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837799.350672:0:15212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788837799.353641:0:15212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788837799.353649:0:15212:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1788837799.353834:0:15212:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837799.353842:0:15212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788837799.356339:0:8542:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788837799.356347:0:8542:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788837799.356360:0:8542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788837799.357457:0:15212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788837799.357465:0:15212:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1788837799.357480:0:15212:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837799.357482:0:15212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788837799.358101:0:9992:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788837799.358105:0:9992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788837799.358117:0:9992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788837799.360272:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeb12 00000020:00000080:3.0:1788837799.360284:0:15212:0:(genops.c:885:class_export_put()) final put ffff889ac4421000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788837799.363684:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac4421000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788837799.364419:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeb27 00000020:00000080:3.0:1788837799.364428:0:15212:0:(genops.c:885:class_export_put()) final put ffff889ac4448000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788837799.364453:0:15212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788837799.364459:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837799.364466:0:15212:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788837799.364470:0:15212:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff889adeb799b8) has no exports 00000020:00000080:0.0:1788837799.364630:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac4448000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1788837799.365069:0:15212:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788837799.365079:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeef5d 00000020:00000080:3.0:1788837799.365085:0:15212:0:(genops.c:885:class_export_put()) final put ffff8899c322b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788837799.365100:0:15212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788837799.365104:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837799.365114:0:15212:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788837799.365117:0:15212:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8899c3648000) has no exports 00000020:00000080:3.0:1788837799.365124:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeef56 00000020:00000080:3.0:1788837799.365128:0:15212:0:(genops.c:885:class_export_put()) final put ffff8899c3228000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788837799.365472:0:15212:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788837799.365478:0:15212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788837799.365482:0:15212:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788837799.365487:0:15212:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837799.365490:0:15212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788837799.365542:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837799.365628:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c322b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788837799.365646:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3228000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788837799.365659:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c322b800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788837799.366043:0:15212:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837799.366047:0:15212:0:(genops.c:885:class_export_put()) final put ffff8899c322a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788837799.366050:0:15212:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c322a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788837799.366055:0:15212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837799.366133:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeee1b 00000020:00000080:3.0:1788837799.366149:0:15212:0:(genops.c:885:class_export_put()) final put ffff889affb4e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788837799.366195:0:15212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788837799.366200:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837799.366206:0:15212:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788837799.366209:0:15212:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff889af758cd28) has no exports 00000020:00000080:3.0:1788837799.366213:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeee14 00000020:00000080:3.0:1788837799.366216:0:15212:0:(genops.c:885:class_export_put()) final put ffff889affb4c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788837799.366978:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889affb4e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788837799.367632:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889affb4c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788837799.368107:0:15212:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788837799.368112:0:15212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788837799.368115:0:15212:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788837799.368121:0:15212:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837799.368123:0:15212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788837799.368180:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837799.368192:0:15212:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788837799.368206:0:15212:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788837799.368213:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeccb 00000020:00000080:3.0:1788837799.368220:0:15212:0:(genops.c:885:class_export_put()) final put ffff889b01bb0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788837799.368225:0:15212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788837799.368232:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837799.368237:0:15212:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788837799.368240:0:15212:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff889ae7f3cd28) has no exports 00000020:00000080:3.0:1788837799.368245:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeecc4 00000020:00000080:3.0:1788837799.368249:0:15212:0:(genops.c:885:class_export_put()) final put ffff889afa550000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788837799.368744:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889affb4b000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788837799.368751:0:38:0:(genops.c:885:class_export_put()) final put ffff8899c21e4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788837799.368753:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c21e4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788837799.368758:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837799.368853:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889b01bb0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788837799.368858:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889afa550000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788837799.375860:0:15212:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788837799.375870:0:15212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788837799.375874:0:15212:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788837799.375883:0:15212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788837799.375938:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837799.375950:0:15212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837799.375978:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837799.375982:0:15212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837799.375987:0:15212:0:(genops.c:885:class_export_put()) final put ffff889ac4427800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788837799.375991:0:15212:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac4427800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788837799.375999:0:15212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837799.376109:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeb2e 00000020:00000080:0.0:1788837799.376116:0:15212:0:(genops.c:885:class_export_put()) final put ffff889ac444f800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788837799.376121:0:15212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788837799.376125:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837799.376130:0:15212:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788837799.376134:0:15212:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff889adeb7cd28) has no exports 00000020:00000080:0.0:1788837799.376165:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837799.376168:0:15212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788837799.376173:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeb35 00000020:00000080:0.0:1788837799.376190:0:15212:0:(genops.c:885:class_export_put()) final put ffff889ac444b800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788837799.376198:0:15212:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ac3ec4000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788837799.376202:0:15212:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ac3ec4000 3 00000020:01000004:0.0:1788837799.376205:0:15212:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff889ac3ec4000 from lustre-MDT0000 00000020:00000080:0.0:1788837799.376223:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837799.376227:0:15212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788837799.376230:0:15212:0:(genops.c:885:class_export_put()) final put ffff889ac4422800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788837799.376232:0:15212:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac4422800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788837799.376239:0:15212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788837799.376283:0:15212:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788837799.376287:0:15212:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788837799.376290:0:15212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788837799.376292:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837799.376295:0:15212:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788837799.376301:0:15212:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff889af8e36000 b603ecff-2147-4e64-a76e-e3f6861ab0fb 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788837799.376306:0:15212:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff889ac848b370) has exports, disconnecting them 00000020:00080000:0.0:1788837799.376310:0:15212:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff889af8e36000), last request at 1788837551 00000020:00000080:0.0:1788837799.376325:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeead3 00000020:00010000:0.0:1788837799.376329:0:15212:0:(genops.c:1921:obd_stale_export_put()) Put export ffff889af8e36000: total 2 00000100:00080000:0.0:1788837799.376333:0:15212:0:(import.c:65:import_set_state_nolock()) ffff889af8e34000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788837799.376353:0:15212:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff889af8e36000): rc 0 00000020:00080000:0.0:1788837799.376357:0:15212:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff889ac848b370) has no exports 00000100:00100000:1.0:1788837799.376843:0:6518:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff889af8dc0c00:6518] 1 exiting: rc = 0 00000100:00100000:1.0:1788837799.376947:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff889ad868ce00:6516] 0 exiting: rc = 1 00000100:00100000:1.0:1788837799.376997:0:6519:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff889ac5ebd800:6519] 2 exiting: rc = 0 00000020:00000080:1.0:1788837799.377047:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889afa557800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788837799.377054:0:38:0:(genops.c:885:class_export_put()) final put ffff889afa554000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788837799.377056:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889afa554000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788837799.377061:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788837799.377121:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac444f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788837799.377125:0:38:0:(genops.c:885:class_export_put()) final put ffff889ac4424800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788837799.377127:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac4424800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788837799.377130:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788837799.377165:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac444b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1788837799.378048:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378057:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378063:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378068:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378074:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378080:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378089:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378095:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378102:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378108:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378128:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378135:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378153:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378160:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378165:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378171:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378177:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378183:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378189:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378194:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378199:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378204:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378209:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378214:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378220:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378227:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378233:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378238:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378245:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378251:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378256:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378262:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378277:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378283:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378288:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378293:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378299:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378305:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378311:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378316:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378321:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378326:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378331:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378336:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378341:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378355:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378360:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378365:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378380:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378387:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378392:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378398:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378403:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378408:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378413:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378417:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378422:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378428:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378769:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378798:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378804:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378810:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378815:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837799.378820:0:15212:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:1.0:1788837799.381031:0:6513:0:(genops.c:1907:obd_stale_export_get()) Get export ffff889af8e36000: total 0 00010000:00010000:1.0:1788837799.381093:0:6513:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff889af8e36000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788837799.381128:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6db200/0x57f6d4e926aef03d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aef036 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837799.381159:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6da600/0x57f6d4e926aef04b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aef044 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837799.381173:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889b02170000/0x57f6d4e926aeebcf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aeebc8 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837799.381187:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c8a00/0x57f6d4e926aeefe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aeefe2 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837799.381217:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889b02171200/0x57f6d4e926aeebdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aeebd6 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837799.381230:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c9400/0x57f6d4e926aeeff7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aeeff0 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837799.381240:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6da000/0x57f6d4e926aef282 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aef27b expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837799.381249:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa791c00/0x57f6d4e926aef013 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aef00c expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837799.381258:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa790400/0x57f6d4e926aef290 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aef289 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837799.381276:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b17200/0x57f6d4e926aeeef4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aeeeed expref: 5 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837799.381287:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa790000/0x57f6d4e926aef26d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aef266 expref: 4 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837799.381299:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b16400/0x57f6d4e926aef091 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aef08a expref: 3 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837799.381310:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c9e00/0x57f6d4e926aef021 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x57f6d4e926aef01a expref: 2 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837799.381320:0:6513:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff889af8e36000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788837799.381336:0:6513:0:(genops.c:885:class_export_put()) final put ffff889af8e36000/b603ecff-2147-4e64-a76e-e3f6861ab0fb 00010000:00010000:1.0:1788837799.381351:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837799.381359:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837799.381361:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788837799.381382:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889af8e36000/b603ecff-2147-4e64-a76e-e3f6861ab0fb for MGS 00000020:00000080:1.0:1788837799.381411:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889af8e34000 for MGS 00000020:01000000:0.0:1788837799.384900:0:15212:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889afa4566c0 - data ffff889ae533f6c0/ffff8899c270cc00 00000020:01000000:0.0:1788837799.385040:0:15212:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889adecd6ba0 - data ffff889ae5029000/ffff889aded6e400 00000020:00000080:0.0:1788837799.385530:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeab7 00000020:00000080:0.0:1788837799.385540:0:15212:0:(genops.c:885:class_export_put()) final put ffff889ad114d000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788837799.385564:0:15212:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ac3ec4000 from MGS, refs=2 00000020:01000004:0.0:1788837799.385568:0:15212:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ac3ec4000 2 00000020:01000004:0.0:1788837799.385571:0:15212:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff889ac3ec4000 from MGS 00000020:00000080:0.0:1788837799.385592:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837799.385599:0:15212:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788837799.385602:0:15212:0:(genops.c:885:class_export_put()) final put ffff889ad1794800/MGS 00000020:00000080:0.0:1788837799.385604:0:15212:0:(genops.c:844:class_export_destroy()) destroying export ffff889ad1794800/MGS for MGS 00000020:01000000:0.0:1788837799.385610:0:15212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1788837799.385838:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ad114d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788837799.386650:0:15212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788837799.386657:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837799.386674:0:15212:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788837799.386692:0:15212:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff889ae7d38000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788837799.386698:0:15212:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff889ac8578000) has exports, disconnecting them 00000020:00080000:0.0:1788837799.386703:0:15212:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff889ae7d38000), last request at 1788837552 00000020:00000080:0.0:1788837799.386708:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeb82 00000020:00080000:0.0:1788837799.386720:0:15212:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff889ae7d38000): rc 0 00000020:00000080:0.0:1788837799.386724:0:15212:0:(genops.c:885:class_export_put()) final put ffff889ae7d38000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788837799.387383:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7d38000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788837799.388081:0:15212:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788837799.388087:0:15212:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788837799.388091:0:15212:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788837799.388098:0:15212:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788837799.388262:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837799.388269:0:15212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788837799.388274:0:15212:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ac3ec4000 1 00000020:00000080:1.0:1788837799.388279:0:15212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeaa9 00000020:00000080:1.0:1788837799.388285:0:15212:0:(genops.c:885:class_export_put()) final put ffff889ad1790000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788837799.388290:0:15212:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788837799.388294:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837799.388298:0:15212:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788837799.388301:0:15212:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff889ac857b370) has no exports 00000020:00000080:2.0:1788837799.397390:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889ae7d3f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788837799.397407:0:36:0:(genops.c:885:class_export_put()) final put ffff889ae7d3c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788837799.397410:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7d3c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788837799.397422:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788837799.397565:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889ad1790000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788837799.458988:0:15212:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837799.459002:0:15212:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788837799.459008:0:15212:0:(genops.c:885:class_export_put()) final put ffff889ac3ec6000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788837799.459012:0:15212:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac3ec6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788837799.459019:0:15212:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788837799.459129:0:15212:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff889ac3ec6800 00000020:02000400:0.0:1788837799.459337:0:15212:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788837799.609766:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837800.634831:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837801.657000:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837802.434075:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837802.434104:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037005184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837802.434170:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837802.434234:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037005184 00000100:00100000:2.0:1788837802.434241:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037005184 00000100:00100000:2.0:1788837802.434304:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788837802.434314:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037005184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837802.434343:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788837802.434398:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037005184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837802.434405:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788837802.434463:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037005184:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788837802.442173:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788837802.563496:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788837802.681079:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788837803.221145:0:15413:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788837803.253539:0:15413:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788837803.253627:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.253641:0:15413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.253649:0:15413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.253657:0:15413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.253684:0:15413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788837803.253689:0:15413:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788837803.253719:0:15413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788837803.253723:0:15413:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788837803.253730:0:15413:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788837803.253736:0:15413:0:(import.c:65:import_set_state_nolock()) ffff889b01bb2800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788837803.253740:0:15413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788837803.253742:0:15413:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788837803.253745:0:15413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788837803.254665:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254677:0:15413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254685:0:15413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254704:0:15413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254720:0:15413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788837803.254725:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254732:0:15413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254739:0:15413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254745:0:15413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254759:0:15413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788837803.254764:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254770:0:15413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254804:0:15413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254811:0:15413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254826:0:15413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788837803.254831:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889b02045c00/0x57f6d4e926aeebd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254838:0:15413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889b02045c00/0x57f6d4e926aeebd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254844:0:15413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889b02045c00/0x57f6d4e926aeebd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254850:0:15413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889b02045c00/0x57f6d4e926aeebd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837803.254857:0:15413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1788837803.254860:0:15413:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788837803.254884:0:15413:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788837803.254888:0:15413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788837803.254891:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837803.254897:0:15413:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788837803.254903:0:15413:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8899c27c7000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788837803.254909:0:15413:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8899c1b25800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788837803.254914:0:15413:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff889af99a99b8) has exports, disconnecting them 00000020:00080000:3.0:1788837803.254919:0:15413:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8899c27c7000), last request at 1788837798 00000020:00000080:3.0:1788837803.254926:0:15413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeeb5 00000100:00080000:3.0:1788837803.254941:0:15413:0:(import.c:65:import_set_state_nolock()) ffff8899c27c7800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788837803.254982:0:15413:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c27c7000): rc 0 00000020:00000080:3.0:1788837803.254985:0:15413:0:(genops.c:885:class_export_put()) final put ffff8899c27c7000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788837803.254993:0:15413:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8899c1b25800), last request at 1788837798 00000020:00000080:3.0:1788837803.255001:0:15413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeed8f 00000100:00080000:3.0:1788837803.255006:0:15413:0:(import.c:65:import_set_state_nolock()) ffff8899c1b23000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788837803.255011:0:15413:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c1b25800): rc 0 00000020:00000080:3.0:1788837803.255013:0:15413:0:(genops.c:885:class_export_put()) final put ffff8899c1b25800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788837803.255019:0:15413:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa3bc8106fae0 00000100:00080000:3.0:1788837803.255034:0:15413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788837803.255036:0:15413:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1788837803.255861:0:15413:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788837803.255868:0:15413:0:(import.c:65:import_set_state_nolock()) ffff889ae7f56000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1788837803.255948:0:10392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788837803.255956:0:10392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.255964:0:10392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db600 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837803.255968:0:10392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.255976:0:10392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837803.255984:0:10392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837803.255990:0:10392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837803.255993:0:10392:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788837803.255995:0:10392:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788837803.256033:0:10392:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256039:0:10392:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837803.256070:0:10392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256077:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6db600/0x57f6d4e926aef036 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef03d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256090:0:10392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788837803.256093:0:10392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256113:0:10392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791600 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837803.256116:0:10392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256123:0:10392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837803.256129:0:10392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837803.256134:0:10392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837803.256137:0:10392:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1788837803.256139:0:10392:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1788837803.256153:0:10392:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256159:0:10392:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837803.256175:0:10392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256183:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa791600/0x57f6d4e926aef044 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef04b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256193:0:10392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788837803.256196:0:10392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256202:0:10392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da200 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837803.256204:0:10392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256216:0:10392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837803.256221:0:10392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837803.256226:0:10392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837803.256228:0:10392:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788837803.256230:0:10392:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788837803.256242:0:10392:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256248:0:10392:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837803.256253:0:10392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256259:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6da200/0x57f6d4e926aeeeed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aeeef4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256270:0:10392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837803.256274:0:10392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256280:0:10392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db000 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837803.256282:0:10392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256289:0:10392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837803.256305:0:10392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837803.256311:0:10392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788837803.256313:0:10392:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788837803.256315:0:10392:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788837803.256328:0:10392:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256334:0:10392:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837803.256340:0:10392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256346:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6db000/0x57f6d4e926aef289 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aef290 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256356:0:10392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837803.256360:0:10392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889b02045c00/0x57f6d4e926aeebd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256379:0:10392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889b02045c00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837803.256382:0:10392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889b02045c00/0x57f6d4e926aeebd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256390:0:10392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889b02045c00/0x57f6d4e926aeebd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837803.256396:0:10392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889b02045c00/0x57f6d4e926aeebd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837803.256411:0:10392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837803.256413:0:10392:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788837803.256415:0:10392:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788837803.256428:0:10392:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889b02045c00/0x57f6d4e926aeebd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256434:0:10392:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837803.256439:0:10392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889b02045c00/0x57f6d4e926aeebd6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256445:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889b02045c00/0x57f6d4e926aeebd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x57f6d4e926aeebdd expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837803.256458:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837803.256460:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837803.256462:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837803.256550:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732037005696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837803.256624:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837803.256687:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788837803.256693:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732037005312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837803.256715:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837803.256730:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732037005824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837803.256747:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837803.256770:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732037005568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837803.256827:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837803.256846:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837803.256851:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732037005440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837803.256879:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837803.256902:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037005696 00000100:00100000:2.0:1788837803.256908:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037005696 00000100:00100000:2.0:1788837803.256937:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037005312 00000100:00100000:2.0:1788837803.256940:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037005312 00000100:00100000:2.0:1788837803.256948:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037005824 00000100:00100000:2.0:1788837803.256950:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037005824 00000100:00100000:2.0:1788837803.256965:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037005568 00000100:00100000:2.0:1788837803.256967:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037005568 00000100:00100000:2.0:1788837803.256975:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037005440 00000100:00100000:2.0:1788837803.256977:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037005440 00000100:00100000:2.0:1788837803.256989:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788837803.256996:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac8560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1875732037005696:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788837803.257002:0:6510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788837803 with bad export cookie 6338487623412017875 00010000:00010000:1.0:1788837803.259509:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788837803.259528:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c27c7000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788837803.259607:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c1b25800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788837803.259630:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c27c7800 for lustre-MDT0001 00000020:00000080:1.0:1788837803.259635:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c1b23000 for lustre-MDT0001 00010000:00010000:0.0:1788837803.259828:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837803.259860:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788837803.259869:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3648:x1875732037005312:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788837803.259876:0:6511:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788837803 with bad export cookie 6338487623412017875 00000100:00100000:0.0:1788837803.259978:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3648:x1875732037005312:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (3260us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788837803.259985:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788837803.260010:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788837803.260015:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3648:x1875732037005824:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788837803.260019:0:6511:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788837803 with bad export cookie 6338487623412017875 00000100:00100000:0.0:1788837803.260044:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3648:x1875732037005824:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (3295us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788837803.260063:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788837803.260076:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788837803.260081:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3651:x1875732037005568:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788837803.260084:0:6511:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788837803 with bad export cookie 6338487623412017875 00000100:00100000:0.0:1788837803.260117:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3651:x1875732037005568:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (3290us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788837803.260123:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788837803.260135:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788837803.260139:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3651:x1875732037005440:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788837803.260143:0:6511:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788837803 with bad export cookie 6338487623412017875 00000100:00100000:0.0:1788837803.260167:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3651:x1875732037005440:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (3287us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788837803.260172:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788837803.260219:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788837803.260224:0:3651:0:(import.c:65:import_set_state_nolock()) ffff889af8e35000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788837803.260227:0:3651:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.103@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788837803.260848:0:15413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788837803.260853:0:15413:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1788837803.260871:0:15413:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788837803.260933:0:15413:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788837803.260954:0:15413:0:(import.c:65:import_set_state_nolock()) ffff889afa551000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788837803.260969:0:15413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788837803.260972:0:15413:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1788837803.260986:0:15413:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788837803.261047:0:15413:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788837803.261055:0:15413:0:(import.c:65:import_set_state_nolock()) ffff889affb24000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788837803.261078:0:15413:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff889af99a99b8) has no exports 00000100:00100000:1.0:1788837803.262593:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037005952:0@lo:9:umount.0 00000100:00100000:1.0:1788837803.262663:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837803.262700:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037006080:0@lo:9:umount.0 00000100:00100000:1.0:1788837803.262719:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788837803.262803:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1788837803.262863:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037005952 00000100:00100000:3.0:1788837803.262870:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037005952 00000100:00100000:3.0:1788837803.262909:0:8544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037006080 00000100:00100000:3.0:1788837803.262912:0:8544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037006080 00000100:00100000:3.0:1788837803.262942:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788837803.262951:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875732037005952:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788837803.262975:0:8544:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeddc 00000100:00080000:3.0:1788837803.262983:0:8544:0:(import.c:65:import_set_state_nolock()) ffff889affb24800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788837803.263019:0:8544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788837803.263155:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3647:x1875732037005952:12345-0@lo:9:umount.0 Request processed in 205us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837803.263162:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788837803.263178:0:8544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788837803.263184:0:8544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875732037006080:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788837803.263196:0:8544:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeef1e 00000100:00080000:3.0:1788837803.263201:0:8544:0:(import.c:65:import_set_state_nolock()) ffff8899c321f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788837803.263223:0:8544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788837803.263291:0:8544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3647:x1875732037006080:12345-0@lo:9:umount.0 Request processed in 107us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837803.263298:0:8544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788837803.263314:0:6520:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788837803.270872:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837803.272860:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788837803.272916:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889afa551000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788837803.272936:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788837803.272938:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837803.272944:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037005952:0@lo:9:umount.0 00000100:00080000:3.0:1788837803.272961:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889affb24000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788837803.272969:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788837803.272971:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837803.272973:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037006080:0@lo:9:umount.0 00000100:00100000:2.0:1788837803.275103:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac8560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1875732037005696:12345-0@lo:103:ldlm_bl.0 Request processed in 18100us (18473us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788837803.275117:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788837803.288543:0:3651:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.103@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788837803.288549:0:3651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788837803.288558:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c27bd880 x1875732037005696/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788837819 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837803.288638:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c27bc700 x1875732037005312/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788837819 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837803.288647:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c27bce00 x1875732037005824/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788837819 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837803.288655:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c27bdf80 x1875732037005568/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788837819 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837803.288683:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c27bd500 x1875732037005440/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788837819 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788837803.288699:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788837803.288702:0:3651:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788837803.288703:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788837803.288726:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff889af8e35000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:0.0:1788837803.288726:0:3651:0:(import.c:65:import_set_state_nolock()) ffff889af8e35000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837803.288731:0:3651:0:(import.c:510:import_select_connection()) MGC192.168.201.103@tcp: connect to NID 0@lo last attempt 168 00000100:00080000:0.0:1788837803.288740:0:3651:0:(import.c:624:import_select_connection()) MGC192.168.201.103@tcp: import ffff889af8e35000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837803.288754:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732037005824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837803.288761:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732037005696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837803.288768:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c44ca300 x1875732037006208/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837803.288808:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3648:1875732037005312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837803.289197:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732037005568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837803.289210:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3651:1875732037005440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837803.289271:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3647:1875732037006208:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1788837803.289317:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875732037006208 offset 0 length 520: 4 00000020:00080000:3.0:1788837803.300693:0:15413:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff889af99a99b8) has no exports 00000020:01000000:2.0:1788837803.370612:0:15413:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8899c215d1e0 - data ffff889ae533c798/ffff8899c3564800 00000020:01000000:2.0:1788837803.370772:0:15413:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889ac4417540 - data ffff889ae5180870/ffff889afa567000 00000001:00000004:2.0:1788837803.386661:0:15413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788837803.429594:0:15413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788837803.429603:0:15413:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788837803.429611:0:15413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788837803.431194:0:15413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788837803.431201:0:15413:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788837803.431570:0:15413:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788837803.431575:0:15413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788837803.438001:0:8537:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788837803.438011:0:8537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788837803.438024:0:8537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788837803.438567:0:15413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788837803.438572:0:15413:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788837803.438592:0:15413:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788837803.438604:0:15413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788837803.439579:0:9988:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788837803.439584:0:9988:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788837803.439596:0:9988:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788837803.442240:0:15413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeebf9 00000020:00000080:2.0:1788837803.442254:0:15413:0:(genops.c:885:class_export_put()) final put ffff889af99b5800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788837803.442706:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889af99b5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788837803.446288:0:15413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeec0e 00000020:00000080:2.0:1788837803.446303:0:15413:0:(genops.c:885:class_export_put()) final put ffff889af99b1800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788837803.446370:0:15413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788837803.446375:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837803.446384:0:15413:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788837803.446388:0:15413:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff889af99ab370) has no exports 00000004:01000000:2.0:1788837803.446559:0:15413:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788837803.446580:0:15413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeef17 00000020:00000080:2.0:1788837803.446585:0:15413:0:(genops.c:885:class_export_put()) final put ffff8899c3241000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788837803.451634:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889af99b1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788837803.452311:0:15413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788837803.452339:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837803.452353:0:15413:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788837803.452359:0:15413:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff889afc3fcd28) has no exports 00000020:00000080:2.0:1788837803.452380:0:15413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeef10 00000020:00000080:2.0:1788837803.452389:0:15413:0:(genops.c:885:class_export_put()) final put ffff889affb27800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788837803.452811:0:15413:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788837803.452816:0:15413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788837803.452820:0:15413:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1788837803.452826:0:15413:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788837803.452828:0:15413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788837803.452862:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837803.452869:0:15413:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788837803.452875:0:15413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeedd5 00000020:00000080:2.0:1788837803.452880:0:15413:0:(genops.c:885:class_export_put()) final put ffff889ae7ed6000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788837803.452884:0:15413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788837803.452887:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837803.452891:0:15413:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788837803.452894:0:15413:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff889afc3f8000) has no exports 00000020:00000080:2.0:1788837803.452898:0:15413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeedce 00000020:00000080:2.0:1788837803.452901:0:15413:0:(genops.c:885:class_export_put()) final put ffff889b01ba7800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788837803.453219:0:15413:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788837803.453223:0:15413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788837803.453225:0:15413:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1788837803.453228:0:15413:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788837803.453230:0:15413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788837803.453255:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837803.453261:0:15413:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788837803.453276:0:15413:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788837803.453283:0:15413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeec31 00000020:00000080:2.0:1788837803.453287:0:15413:0:(genops.c:885:class_export_put()) final put ffff889ac4420800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788837803.453291:0:15413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788837803.453294:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837803.453298:0:15413:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788837803.453300:0:15413:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff889af99acd28) has no exports 00000020:00000080:2.0:1788837803.453304:0:15413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeec2a 00000020:00000080:2.0:1788837803.453306:0:15413:0:(genops.c:885:class_export_put()) final put ffff889af99b3000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788837803.454102:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3241000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788837803.454119:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889affb27800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788837803.454125:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889affb24000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788837803.454132:0:36:0:(genops.c:885:class_export_put()) final put ffff8899c27c3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788837803.454134:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c27c3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788837803.454138:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788837803.454215:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7ed6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788837803.454220:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889b01ba7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788837803.454225:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889afa551000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788837803.454229:0:36:0:(genops.c:885:class_export_put()) final put ffff889ae7ed4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788837803.454231:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7ed4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788837803.454234:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788837803.454261:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac4420800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788837803.454266:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889af99b3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788837803.495066:0:15413:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788837803.495076:0:15413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788837803.495080:0:15413:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788837803.495089:0:15413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788837803.495151:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837803.495163:0:15413:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788837803.495190:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837803.495210:0:15413:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788837803.495216:0:15413:0:(genops.c:885:class_export_put()) final put ffff889ae7f57000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788837803.495220:0:15413:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7f57000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788837803.495235:0:15413:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788837803.495416:0:15413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeec15 00000020:00000080:0.0:1788837803.495425:0:15413:0:(genops.c:885:class_export_put()) final put ffff889af99b6800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788837803.495430:0:15413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788837803.495434:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837803.495439:0:15413:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788837803.495443:0:15413:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff889af99a8000) has no exports 00000020:00000080:0.0:1788837803.495462:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837803.495465:0:15413:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788837803.495469:0:15413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeec1c 00000020:00000080:0.0:1788837803.495473:0:15413:0:(genops.c:885:class_export_put()) final put ffff889af99b3800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788837803.495481:0:15413:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ae7d4b000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788837803.495484:0:15413:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ae7d4b000 2 00000020:01000004:0.0:1788837803.495487:0:15413:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff889ae7d4b000 from lustre-MDT0001 00000020:00000080:0.0:1788837803.495504:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837803.495508:0:15413:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788837803.495510:0:15413:0:(genops.c:885:class_export_put()) final put ffff889af99b4800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788837803.495512:0:15413:0:(genops.c:844:class_export_destroy()) destroying export ffff889af99b4800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788837803.495519:0:15413:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788837803.495549:0:15413:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788837803.495552:0:15413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788837803.495555:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837803.495559:0:15413:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788837803.495579:0:15413:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff889b01bb5000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788837803.495585:0:15413:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff889ac8488000) has exports, disconnecting them 00000020:00080000:0.0:1788837803.495589:0:15413:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff889b01bb5000), last request at 1788837574 00000020:00000080:0.0:1788837803.495593:0:15413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeec70 00000020:00080000:0.0:1788837803.495607:0:15413:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff889b01bb5000): rc 0 00000020:00000080:0.0:1788837803.495618:0:15413:0:(genops.c:885:class_export_put()) final put ffff889b01bb5000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788837803.496310:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889ae7f56000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788837803.496320:0:36:0:(genops.c:885:class_export_put()) final put ffff889ac84bd800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788837803.496322:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac84bd800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788837803.496332:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788837803.496434:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889af99b6800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788837803.496438:0:36:0:(genops.c:885:class_export_put()) final put ffff889af99b4000/lustre-MDD0001_UUID 00000020:00000080:1.0:1788837803.496448:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889af99b4000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788837803.496451:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788837803.496595:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889af99b3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788837803.496600:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889b01bb5000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788837803.537832:0:15413:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788837803.537841:0:15413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788837803.537845:0:15413:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788837803.537852:0:15413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788837803.538044:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837803.538054:0:15413:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788837803.538061:0:15413:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ae7d4b000 1 00000020:00000080:1.0:1788837803.538068:0:15413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeebac 00000020:00000080:1.0:1788837803.538075:0:15413:0:(genops.c:885:class_export_put()) final put ffff889ae7d3b800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788837803.538081:0:15413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788837803.538086:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837803.538091:0:15413:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788837803.538094:0:15413:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff889ac857cd28) has no exports 00000020:00000080:2.0:1788837803.540550:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889b01bb2800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788837803.540575:0:36:0:(genops.c:885:class_export_put()) final put ffff889ae7ed3800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788837803.540579:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7ed3800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788837803.540592:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788837803.540659:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7d3b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788837803.588194:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837803.588206:0:15413:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788837803.588211:0:15413:0:(genops.c:885:class_export_put()) final put ffff889ae7d4c800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788837803.588214:0:15413:0:(genops.c:844:class_export_destroy()) destroying export ffff889ae7d4c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788837803.588222:0:15413:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788837803.588314:0:15413:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff889ae7d4d000 00000020:01000000:1.0:1788837803.588329:0:15413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788837803.588331:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837803.588334:0:15413:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788837803.588338:0:15413:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff889adeb7b370) has no exports 00000100:00100000:3.0:1788837803.588561:0:9317:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8899c243da00:9317] 3 exiting: rc = 0 00000100:00100000:2.0:1788837803.588692:0:14627:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8899c3de3c00:14627] 4 exiting: rc = 0 00000100:00100000:2.0:1788837803.588832:0:6526:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff889aded69c00:6526] 2 exiting: rc = 0 00000100:00100000:0.0:1788837803.589031:0:6525:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff889ac8787600:6525] 1 exiting: rc = 0 00000100:00100000:1.0:1788837803.589164:0:6524:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff889ac8786800:6524] 0 exiting: rc = 1 00000100:00100000:0.0:1788837803.589284:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589292:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589298:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589303:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589308:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589313:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589318:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589324:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589329:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589333:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589338:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589343:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589348:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589353:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589368:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589375:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589380:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589385:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589390:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589395:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589401:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589406:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589411:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589416:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589421:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589426:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589432:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589438:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589443:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589448:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589453:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589458:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589463:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589483:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589488:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589493:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589499:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589504:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589509:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589514:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589519:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589524:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589529:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589534:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589540:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589545:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589550:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589555:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589561:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589641:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589650:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589655:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589660:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589666:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589672:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589678:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589682:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589687:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589691:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589697:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589703:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589708:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589714:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.589719:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837803.593629:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff889aded69e00:6528] 1 exiting: rc = 0 00000100:00100000:3.0:1788837803.595441:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff889af8e0ee00:6527] 0 exiting: rc = 1 00000100:00100000:1.0:1788837803.595808:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595817:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595823:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595841:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595847:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595853:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595858:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595865:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595871:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595877:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595882:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595889:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595895:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595900:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595905:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595909:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595914:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595918:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595924:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595929:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595934:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595940:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595945:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595950:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595955:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595959:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595965:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595970:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595976:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595981:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595987:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595993:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.595999:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596004:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596009:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596014:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596019:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596024:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596036:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596042:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596047:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596052:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596057:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596061:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596066:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596070:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596075:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596079:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596084:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596089:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596093:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596098:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596103:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596107:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596112:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596117:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596122:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596126:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596131:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596136:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596141:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596145:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596151:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.596155:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837803.596715:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff889adea35800:6529] 0 exiting: rc = 1 00000100:00100000:3.0:1788837803.596831:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff889adea35600:6530] 1 exiting: rc = 0 00000100:00100000:2.0:1788837803.601392:0:7894:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff889afa4a1a00:7894] 2 exiting: rc = 0 00000100:00100000:1.0:1788837803.601639:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.601668:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.601676:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.601917:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.601927:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.601934:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.601939:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.601945:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.601951:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.601970:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.601976:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.601982:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.601987:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602007:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602015:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602021:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602026:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602032:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602038:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602044:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602050:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602055:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602061:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602066:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602072:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602090:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602097:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602103:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602109:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602115:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602121:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602128:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602133:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602139:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602144:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602150:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602156:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602175:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602182:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602188:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602194:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602199:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602204:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602209:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602223:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602230:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602235:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602241:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602246:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602264:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602270:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602276:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602281:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602286:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602291:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602298:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602304:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602309:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602314:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602320:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602325:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602342:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602348:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.602354:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837803.614285:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff889adea34200:6531] 0 exiting: rc = 1 00000100:00100000:1.0:1788837803.614656:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff889adea34800:6532] 1 exiting: rc = 0 00000100:00100000:0.0:1788837803.615467:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615475:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615481:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615486:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615512:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615518:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615524:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615529:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615536:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615541:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615545:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615549:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615554:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615559:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615629:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615636:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615641:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615646:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615651:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615655:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615660:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615665:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615670:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615674:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615679:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615683:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615689:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615693:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615698:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615703:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615708:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615713:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615718:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615723:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615728:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615732:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615737:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615742:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615747:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615759:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615764:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615769:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615853:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615860:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615866:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615871:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615876:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615881:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615885:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615889:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615895:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615899:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615903:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615907:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615912:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615918:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615923:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615927:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615932:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615937:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615941:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615946:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615951:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.615955:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837803.617316:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff889af8db3e00:6533] 0 exiting: rc = 1 00000100:00100000:0.0:1788837803.617492:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff889af8db2400:6534] 1 exiting: rc = 0 00000100:00100000:1.0:1788837803.617692:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.617699:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.617705:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.617711:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.617772:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618067:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618072:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618077:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618082:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618087:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618091:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618096:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618100:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618105:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618121:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618126:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618130:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618135:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618139:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618144:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618149:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618153:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618158:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618163:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618167:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618172:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618176:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618181:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618186:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618190:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618195:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618200:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618205:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618210:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618215:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618219:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618224:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618229:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618234:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618240:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618245:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618250:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618255:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618261:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618266:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618272:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618277:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618282:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618286:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618298:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618303:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618309:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618313:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618318:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618323:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618327:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618333:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618338:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618343:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618348:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618354:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618368:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618374:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.618380:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837803.619094:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff889af8db3c00:6535] 0 exiting: rc = 1 00000100:00100000:2.0:1788837803.619170:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff889ae566e600:6536] 1 exiting: rc = 0 00000100:00100000:0.0:1788837803.619246:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619253:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619258:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619263:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619268:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619273:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619279:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619283:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619288:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619300:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619306:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619311:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619316:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619321:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619326:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619331:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619336:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619340:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619345:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619350:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619354:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619369:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619375:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619379:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619384:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619388:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619393:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619398:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619403:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619407:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619412:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619417:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619422:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619433:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619439:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619444:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619449:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619453:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619458:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619463:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619468:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619473:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619478:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619482:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619493:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619498:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619509:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619514:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619519:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619524:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619528:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619533:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619538:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619543:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619547:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619551:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619556:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619560:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619570:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619575:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619579:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619583:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619589:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837803.619593:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837803.620259:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff889ad0407000:6537] 0 exiting: rc = 1 00000100:00100000:0.0:1788837803.621070:0:6539:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff889ad0406c00:6539] 2 exiting: rc = 0 00000100:00100000:3.0:1788837803.621171:0:6538:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff889ad0406e00:6538] 1 exiting: rc = 0 00000100:00100000:1.0:1788837803.621291:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621306:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621313:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621318:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621324:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621329:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621335:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621340:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621345:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621351:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621382:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621388:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621393:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621398:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621404:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621409:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621414:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621420:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621425:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621438:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621452:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621457:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621462:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621468:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621473:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621479:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621484:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621489:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621494:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621500:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621512:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621517:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621522:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621528:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621544:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621550:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621556:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621561:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621573:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621579:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621584:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621590:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621596:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621602:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621607:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621613:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621618:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621624:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621629:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621634:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621640:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621645:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621651:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621656:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621662:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621672:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621678:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621684:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621700:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621706:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621712:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621725:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621731:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837803.621736:0:15413:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788837803.626126:0:15413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837803.626139:0:15413:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788837803.626145:0:15413:0:(genops.c:885:class_export_put()) final put ffff889ac85f3000/MDS_uuid 00000020:00000080:0.0:1788837803.626149:0:15413:0:(genops.c:844:class_export_destroy()) destroying export ffff889ac85f3000/MDS_uuid for MDS 00000020:01000000:0.0:1788837803.626155:0:15413:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788837803.626287:0:15413:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788837803.704902:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788837803.961729:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788837803.961737:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788837803.961741:0:36:0:(import.c:65:import_set_state_nolock()) ffff8899c21e0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837803.961748:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 415 00000100:00080000:3.0:1788837803.961753:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788837803.961760:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8899c21e0800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837803.961981:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ad17aed80 x1875732037006336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837803.962069:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037006464:0@lo:400:kworker.0 00000400:00000100:0.0:1788837803.962122:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037006464 offset 0 length 224: 4 00000100:00080000:3.0:1788837803.962261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788837803.962266:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788837803.962268:0:36:0:(import.c:65:import_set_state_nolock()) ffff8899c3247800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837803.962272:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 415 00000100:00080000:3.0:1788837803.962275:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788837803.962279:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8899c3247800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837803.962295:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ad17ace00 x1875732037006592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837803.962380:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875732037006336:0@lo:38:kworker.0 00000400:00000100:1.0:1788837803.962405:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037006336 offset 0 length 520: 4 00000100:00100000:1.0:1788837803.962424:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037006592:0@lo:38:kworker.0 00000400:00000100:1.0:1788837803.962440:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037006592 offset 0 length 520: 4 00000100:00100000:2.0:1788837803.962524:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732037006720:0@lo:400:kworker.0 00000400:00000100:2.0:1788837803.962573:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037006720 offset 0 length 224: 4 00010000:00010000:3.0:1788837804.729206:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837805.752982:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837806.777943:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788837807.301747:0:15613:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788837807.326263:0:15613:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788837807.326334:0:15613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef013 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837807.326349:0:15613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef013 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837807.326370:0:15613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef013 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837807.326378:0:15613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef013 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837807.326414:0:15613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788837807.326421:0:15613:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788837807.326447:0:15613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788837807.326458:0:15613:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889ad17aed80 x1875732037006336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837818 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837807.326476:0:15613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788837807.326482:0:15613:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788837807.326488:0:15613:0:(import.c:65:import_set_state_nolock()) ffff8899c21e0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788837807.326493:0:15613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788837807.326497:0:15613:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889ad17aed80 x1875732037006336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837818 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788837807.326653:0:10392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837807.326662:0:10392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef013 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837807.326670:0:10392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa791e00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837807.326673:0:10392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef013 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837807.326682:0:10392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aef013 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837807.326690:0:10392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aef013 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837807.326696:0:10392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837807.326699:0:10392:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788837807.326701:0:10392:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788837807.326714:0:10392:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8e35000 00010000:00010000:2.0:1788837807.326718:0:10392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926aef013 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837807.326725:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa791e00/0x57f6d4e926aef00c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926aef013 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837807.326736:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837807.326738:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837807.326740:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837807.326912:0:15613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788837807.326918:0:15613:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:1.0:1788837807.327111:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875732037006336:0@lo:38:kworker.0 00000100:00080000:3.0:1788837807.328255:0:15613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788837807.328266:0:15613:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889ad17af100 x1875732037006464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837819 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837807.328355:0:15613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788837807.328361:0:15613:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788837807.328383:0:15613:0:(import.c:65:import_set_state_nolock()) ffff8899c21e0000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788837807.328599:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875732037006848:0@lo:39:umount.0 00000400:00000100:1.0:1788837807.328650:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037006848 offset 0 length 224: 4 00000100:00100000:0.0:1788837807.329560:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037006464:0@lo:400:kworker.0 00010000:00010000:3.0:1788837807.800995:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837808.825073:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788837809.081900:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b603ecff-2147-4e64-a76e-e3f6861ab0fb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837809.081914:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b603ecff-2147-4e64-a76e-e3f6861ab0fb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788837809.081925:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837809.081929:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788837809.082188:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037006976:0@lo:400:kworker.0 00000400:00000100:3.0:1788837809.082258:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037006976 offset 0 length 224: 4 00000001:00100000:1.0:1788837809.085660:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788837809.085673:0:9519:0:(genops.c:885:class_export_put()) final put ffff8899c321c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788837809.085814:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c321c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788837809.085880:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c321f000 for lustre-OST0001 00000001:00100000:1.0:1788837809.086587:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788837809.086655:0:8433:0:(genops.c:885:class_export_put()) final put ffff889affb25800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788837809.087044:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889affb25800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788837809.087189:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889affb24800 for lustre-OST0000 00010000:00010000:2.0:1788837809.849075:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837810.873227:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837811.897618:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837812.921017:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837813.496964:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837803/real 1788837803] req@ffff8899c44ca300 x1875732037006208/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788837813 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837813.497013:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8899c44ca300 x1875732037006208/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788837813 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788837813.497041:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889af8e35000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837813.497077:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788837813.497107:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3647:1875732037006208:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1788837813.497252:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b603ecff-2147-4e64-a76e-e3f6861ab0fb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837813.497259:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788837813.497263:0:36:0:(import.c:65:import_set_state_nolock()) ffff889af8e35000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837813.497269:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.103@tcp: connect to NID 0@lo last attempt 420 00000100:00080000:0.0:1788837813.497275:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.103@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788837813.497295:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.103@tcp: import ffff889af8e35000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788837813.497345:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c44c8380 x1875732037007104/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788837813.497371:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837813.497377:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788837813.497501:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837813.497529:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037007232:0@lo:400:kworker.0 00000400:00000100:2.0:1788837813.497588:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037007232 offset 0 length 224: 4 00000100:00100000:1.0:1788837813.497630:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3647:1875732037007104:0@lo:250:kworker.0 00000400:00000100:1.0:1788837813.497692:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875732037007104 offset 0 length 520: 4 00010000:00010000:3.0:1788837813.944922:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837814.969521:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837815.993049:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837817.016872:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837817.592916:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837807/real 1788837807] req@ffff889ad17adc00 x1875732037006848/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788837817 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837817.592950:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889ad17adc00 x1875732037006848/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788837817 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788837817.592968:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c21e0000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788837817.592994:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875732037006848:0@lo:39:umount.0 00000100:00080000:3.0:1788837817.593039:0:15613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788837817.593044:0:15613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788837817.593049:0:15613:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788837817.593973:0:15613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef021 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837817.593989:0:15613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef021 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837817.593996:0:15613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef021 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837817.594003:0:15613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef021 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837817.594403:0:15613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837817.594415:0:15613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef282 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837817.594423:0:15613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef282 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837817.594429:0:15613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef282 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837817.594450:0:15613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef282 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.602266:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837817.602282:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef021 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.602294:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9c00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837817.602298:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef021 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.602309:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aef021 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837817.602316:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aef021 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837817.602322:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788837817.602325:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788837817.602359:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8e35000 00010000:00010000:0.0:1788837817.602363:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926aef021 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.602369:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926aef01a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926aef021 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.602387:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837817.602391:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef282 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.602397:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac0031e00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837817.602400:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef282 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.602406:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aef282 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837817.602412:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aef282 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837817.602417:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788837817.602420:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788837817.602424:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8e35000 00010000:00010000:0.0:1788837817.602426:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926aef282 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837817.602434:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837817.602435:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837817.602438:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837817.608209:0:15613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788837817.608232:0:15613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac0031e00/0x57f6d4e926aef27b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926aef282 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837817.608261:0:15613:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788837817.608276:0:15613:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788837817.608279:0:15613:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788837817.608324:0:15613:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788837817.608330:0:15613:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788837817.608342:0:15613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837817.608348:0:15613:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788837817.608353:0:15613:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff889ae7f3b370) has no exports 00000020:00080000:3.0:1788837817.608387:0:15613:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff889ae7f3b370) has no exports 00010000:00010000:2.0:1788837817.609891:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788837817.616661:0:15613:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8899c3443120 - data ffff8899c1d1b870/ffff8899c34da800 00000020:01000000:3.0:1788837817.619750:0:15613:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889afa4560c0 - data ffff889ae5289798/ffff889af7620800 00100000:10000000:3.0:1788837817.629828:0:15613:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788837817.637342:0:15613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeed49 00000020:00000080:2.0:1788837817.637356:0:15613:0:(genops.c:885:class_export_put()) final put ffff8899c1b24800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788837817.637370:0:15613:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889afa550800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788837817.637374:0:15613:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889afa550800 2 00000020:01000004:2.0:1788837817.637377:0:15613:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff889afa550800 from lustre-OST0000 00000020:00000080:2.0:1788837817.637406:0:15613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837817.637416:0:15613:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788837817.637420:0:15613:0:(genops.c:885:class_export_put()) final put ffff8899c1b22800/lustre-OST0000_UUID 00000020:00000080:2.0:1788837817.637423:0:15613:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c1b22800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788837817.637430:0:15613:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788837817.637481:0:15613:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788837817.637486:0:15613:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788837817.637489:0:15613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837817.637569:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c1b24800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788837817.638705:0:15613:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788837817.638718:0:15613:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8899c21e6000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788837817.638725:0:15613:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff889af75899b8) has exports, disconnecting them 00000020:00080000:2.0:1788837817.638729:0:15613:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8899c21e6000), last request at 1788837595 00000020:00000080:2.0:1788837817.638742:0:15613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeed73 00000020:00080000:2.0:1788837817.638756:0:15613:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c21e6000): rc 0 00000020:00000080:2.0:1788837817.638762:0:15613:0:(genops.c:885:class_export_put()) final put ffff8899c21e6000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788837817.640250:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c21e6000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788837817.699141:0:15613:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788837817.699150:0:15613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788837817.699154:0:15613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788837817.699162:0:15613:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788837817.699379:0:15613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837817.699388:0:15613:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788837817.699393:0:15613:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788837817.699397:0:15613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837817.699402:0:15613:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788837817.699409:0:15613:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8899c21e3800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788837817.699416:0:15613:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff889af7588000) has exports, disconnecting them 00000020:00080000:2.0:1788837817.699420:0:15613:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8899c21e3800), last request at 1788837595 00000020:00000080:2.0:1788837817.699424:0:15613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeed88 00000020:00080000:2.0:1788837817.699438:0:15613:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c21e3800): rc 0 00000020:00000080:2.0:1788837817.699442:0:15613:0:(genops.c:885:class_export_put()) final put ffff8899c21e3800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788837817.699932:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c21e0800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788837817.699939:0:37:0:(genops.c:885:class_export_put()) final put ffff8899c21e1000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788837817.699942:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c21e1000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788837817.699953:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788837817.700453:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c21e3800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788837817.729757:0:15613:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788837817.729767:0:15613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788837817.729771:0:15613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788837817.732112:0:15613:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788837817.732444:0:15613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837817.732455:0:15613:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788837817.732461:0:15613:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889afa550800 1 00000020:00000080:3.0:1788837817.732468:0:15613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeed11 00000020:00000080:3.0:1788837817.732478:0:15613:0:(genops.c:885:class_export_put()) final put ffff889afa703800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788837817.732733:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c21e0000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788837817.732741:0:37:0:(genops.c:885:class_export_put()) final put ffff8899c21e5800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788837817.732744:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c21e5800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788837817.732755:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000000:3.0:1788837817.732895:0:15613:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788837817.733086:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff889afa703800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788837817.733097:0:15613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837817.733104:0:15613:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788837817.733109:0:15613:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff889ac848cd28) has no exports 00000020:00000080:2.0:1788837817.792568:0:15613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837817.792580:0:15613:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788837817.792585:0:15613:0:(genops.c:885:class_export_put()) final put ffff889afa555000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788837817.792597:0:15613:0:(genops.c:844:class_export_destroy()) destroying export ffff889afa555000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788837817.792608:0:15613:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788837817.792711:0:15613:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff889afa556000 00000020:02000400:2.0:1788837817.792751:0:15613:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788837818.051904:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837818.616838:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837803/real 1788837803] req@ffff889ad17ace00 x1875732037006592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788837818 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837818.616868:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889ad17ace00 x1875732037006592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788837818 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788837818.616888:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c3247800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837818.616903:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788837818.616907:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037006592:0@lo:38:kworker.0 00000100:00080000:2.0:1788837818.617843:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b603ecff-2147-4e64-a76e-e3f6861ab0fb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837818.617849:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b603ecff-2147-4e64-a76e-e3f6861ab0fb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788837818.617852:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837818.617855:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788837818.617858:0:37:0:(import.c:65:import_set_state_nolock()) ffff8899c3247800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837818.617862:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 420 00000100:00080000:2.0:1788837818.617868:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788837818.617874:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8899c3247800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837818.617917:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c3dd4000 x1875732037007360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837818.617973:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037007360:0@lo:38:kworker.0 00000400:00000100:1.0:1788837818.618020:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037007360 offset 0 length 520: 4 00000100:00100000:0.0:1788837818.618118:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732037007488:0@lo:400:kworker.0 00000400:00000100:0.0:1788837818.618145:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037007488 offset 0 length 224: 4 00010000:00010000:3.0:1788837819.070023:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788837819.322400:0:3651:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837803/real 1788837803] req@ffff889ad17ac380 x1875732037006720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788837819 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837819.368917:0:3651:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff889ad17ac380 x1875732037006720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788837819 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837819.368935:0:3651:0:(import.c:65:import_set_state_nolock()) ffff8899c3245800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788837819.368940:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788837819.405966:0:3651:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1788837819.406703:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b603ecff-2147-4e64-a76e-e3f6861ab0fb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837819.406711:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b603ecff-2147-4e64-a76e-e3f6861ab0fb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788837819.406714:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837819.406716:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788837819.406718:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837819.406722:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788837819.406726:0:37:0:(import.c:65:import_set_state_nolock()) ffff8899c3245800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837819.406734:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 233 00000100:00080000:0.0:1788837819.406744:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8899c3245800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788837819.406900:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c44c9c00 x1875732037007616/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788837819.406905:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875732037006720:0@lo:400:kworker.0 00000100:00100000:1.0:1788837819.406978:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875732037007616:0@lo:38:kworker.0 00000400:00000100:1.0:1788837819.407105:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875732037007616 offset 0 length 520: 4 00010000:00010000:2.0:1788837820.094218:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837821.113511:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788837821.776599:0:15815:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788837821.793242:0:15815:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788837821.793396:0:15815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeefe9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837821.793411:0:15815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeefe9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837821.793418:0:15815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aeefe9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837821.793425:0:15815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aeefe9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837821.793506:0:15815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788837821.793513:0:15815:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788837821.793548:0:15815:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788837821.793560:0:15815:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c3dd4000 x1875732037007360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837838 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837821.793599:0:15815:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788837821.793606:0:15815:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788837821.793612:0:15815:0:(import.c:65:import_set_state_nolock()) ffff8899c3247800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788837821.793616:0:15815:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788837821.793620:0:15815:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c3dd4000 x1875732037007360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837838 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837821.793625:0:15815:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788837821.793628:0:15815:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:2.0:1788837821.793827:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037007360:0@lo:38:kworker.0 00000100:00080000:3.0:1788837821.794673:0:15815:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788837821.794684:0:15815:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c3dd4380 x1875732037006976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837825 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837821.794707:0:15815:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c44c8a80 x1875732037007232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837829 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837821.794715:0:15815:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c3dd5180 x1875732037007488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837834 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837821.794883:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037007232:0@lo:400:kworker.0 00000100:00100000:3.0:1788837821.794934:0:15815:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c44c9c00 x1875732037007616/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788837829 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837821.794947:0:15815:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788837821.794951:0:15815:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788837821.795013:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732037007488:0@lo:400:kworker.0 00000100:00100000:2.0:1788837821.798874:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037006976:0@lo:400:kworker.0 00000100:00080000:2.0:1788837821.798938:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c3245800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788837821.798942:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1788837821.798946:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875732037007616:0@lo:38:kworker.0 00010000:00010000:0.0:1788837821.799025:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837821.799034:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aeefe9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837821.799053:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16e00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837821.799073:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aeefe9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837821.799084:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aeefe9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837821.799090:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aeefe9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837821.799096:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788837821.799098:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788837821.799101:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788837821.799118:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8e35000 00010000:00010000:0.0:1788837821.799122:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926aeefe9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837821.799129:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b16e00/0x57f6d4e926aeefe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926aeefe9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837821.799141:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837821.799143:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837821.799145:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788837821.799195:0:15815:0:(import.c:65:import_set_state_nolock()) ffff8899c3245800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788837821.799203:0:15815:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788837821.799210:0:15815:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c3dd5180 x1875732037007488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837834 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837821.799219:0:15815:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788837821.799223:0:15815:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788837821.806156:0:15815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aeeff7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837821.806188:0:15815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aeeff7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837821.806195:0:15815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aeeff7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837821.806201:0:15815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aeeff7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837821.806320:0:15815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837821.806329:0:15815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926aef26d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837821.806336:0:15815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926aef26d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837821.806341:0:15815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef26d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837821.806347:0:15815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x57f6d4e926aef26d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837821.809299:0:10392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837821.809316:0:10392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aeeff7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837821.809345:0:10392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da800 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837821.809349:0:10392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aeeff7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837821.809359:0:10392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aeeff7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837821.809366:0:10392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aeeff7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837821.809371:0:10392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837821.809373:0:10392:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1788837821.809388:0:10392:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8e35000 00010000:00010000:2.0:1788837821.809391:0:10392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926aeeff7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837821.809397:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6da800/0x57f6d4e926aeeff0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926aeeff7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837821.809412:0:10392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837821.809415:0:10392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef26d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837821.809420:0:10392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dbc00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837821.809423:0:10392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x57f6d4e926aef26d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837821.809429:0:10392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aef26d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837821.809441:0:10392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aef26d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837821.809445:0:10392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788837821.809447:0:10392:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788837821.809451:0:10392:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8e35000 00010000:00010000:2.0:1788837821.809454:0:10392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926aef26d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837821.809461:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837821.809463:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837821.809465:0:10392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837821.809733:0:15815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788837821.809741:0:15815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6dbc00/0x57f6d4e926aef266 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926aef26d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837821.809757:0:15815:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788837821.809762:0:15815:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788837821.809763:0:15815:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788837821.809823:0:15815:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788837821.809827:0:15815:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788837821.809833:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837821.809839:0:15815:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788837821.809843:0:15815:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8899c266cd28) has no exports 00000020:00080000:3.0:1788837821.809865:0:15815:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8899c266cd28) has no exports 00000020:01000000:3.0:1788837821.815589:0:15815:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8899c34433c0 - data ffff8899c1d1b0d8/ffff889afa64e400 00000020:01000000:3.0:1788837821.816470:0:15815:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8899c215d180 - data ffff889ae524de58/ffff889ac40f0c00 00010000:00010000:1.0:1788837821.818155:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788837821.841407:0:15815:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788837821.849330:0:15815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeee6f 00000020:00000080:2.0:1788837821.849342:0:15815:0:(genops.c:885:class_export_put()) final put ffff8899c2778800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788837821.849366:0:15815:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ae7ed4800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788837821.849370:0:15815:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ae7ed4800 2 00000020:01000004:2.0:1788837821.849373:0:15815:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff889ae7ed4800 from lustre-OST0001 00000020:00000080:2.0:1788837821.849394:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837821.849401:0:15815:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788837821.849404:0:15815:0:(genops.c:885:class_export_put()) final put ffff8899c277b000/lustre-OST0001_UUID 00000020:00000080:2.0:1788837821.849407:0:15815:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c277b000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788837821.849413:0:15815:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788837821.849531:0:15815:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import b603ecff-2147-4e64-a76e-e3f6861ab0fb->MGS 00010000:00010000:2.0:1788837821.849547:0:15815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889b02044600/0x57f6d4e926aeebc8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aeebcf expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837821.849560:0:15815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889b02044600/0x57f6d4e926aeebc8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aeebcf expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837821.849566:0:15815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788837821.849577:0:15815:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788837821.849579:0:15815:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788837821.849593:0:15815:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8e35000 00010000:00010000:2.0:1788837821.849596:0:15815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889b02044600/0x57f6d4e926aeebc8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926aeebcf expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837821.849610:0:15815:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aef08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x57f6d4e926aef091 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837821.849617:0:15815:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aef08a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x57f6d4e926aef091 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837821.849623:0:15815:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788837821.849625:0:15815:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788837821.849627:0:15815:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788837821.849634:0:15815:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889af8e35000 00010000:00010000:2.0:1788837821.849637:0:15815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac2b17a00/0x57f6d4e926aef08a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x57f6d4e926aef091 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788837821.849651:0:15815:0:(import.c:65:import_set_state_nolock()) ffff889af8e35000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788837821.849655:0:15815:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788837821.849658:0:15815:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788837821.849659:0:15815:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788837821.849673:0:15815:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788837821.849684:0:15815:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8899c44c8380 x1875732037007104/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788837828 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788837821.849704:0:15815:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788837821.849707:0:15815:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:1.0:1788837821.849810:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c2778800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1788837821.850009:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b603ecff-2147-4e64-a76e-e3f6861ab0fb:3647:1875732037007104:0@lo:250:kworker.0 10000000:01000000:2.0:1788837821.850146:0:15815:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788837821.850153:0:15815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeac5 00000020:00000080:2.0:1788837821.850157:0:15815:0:(genops.c:885:class_export_put()) final put ffff889aca346800/b603ecff-2147-4e64-a76e-e3f6861ab0fb 00000020:01000000:2.0:1788837821.850173:0:15815:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.103@tcp (flags='') 00000020:00000080:2.0:1788837821.850191:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837821.850196:0:15815:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.103@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788837821.850199:0:15815:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff889ac85799b8) has no exports 10000000:01000000:1.0:1788837821.850250:0:6521:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788837821.850370:0:15815:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.103@tcp: client import never connected 00000100:00080000:2.0:1788837821.850373:0:15815:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788837821.850376:0:15815:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788837821.850378:0:15815:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788837821.850380:0:15815:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788837821.850408:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837821.850413:0:15815:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.103@tcp (uuid b603ecff-2147-4e64-a76e-e3f6861ab0fb) 00000020:01000000:2.0:1788837821.850418:0:15815:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788837821.850421:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837821.850424:0:15815:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788837821.850429:0:15815:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8899c3242800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788837821.850434:0:15815:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8899c266b370) has exports, disconnecting them 00000020:00080000:2.0:1788837821.850438:0:15815:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8899c3242800), last request at 1788837616 00000020:00000080:2.0:1788837821.850442:0:15815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeee99 00000020:00080000:2.0:1788837821.850453:0:15815:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c3242800): rc 0 00000020:00000080:2.0:1788837821.850456:0:15815:0:(genops.c:885:class_export_put()) final put ffff8899c3242800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788837821.850670:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889aca346800/b603ecff-2147-4e64-a76e-e3f6861ab0fb for MGC192.168.201.103@tcp 00000020:00000080:0.0:1788837821.850682:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889af8e35000 for MGC192.168.201.103@tcp 00000020:00000080:0.0:1788837821.850688:0:36:0:(genops.c:885:class_export_put()) final put ffff889af8e33000/b603ecff-2147-4e64-a76e-e3f6861ab0fb 00000020:00000080:0.0:1788837821.850690:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889af8e33000/b603ecff-2147-4e64-a76e-e3f6861ab0fb for MGC192.168.201.103@tcp 00000020:01000000:0.0:1788837821.850693:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.103@tcp (b603ecff-2147-4e64-a76e-e3f6861ab0fb) 00000020:00000080:0.0:1788837821.850963:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3242800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788837821.856856:0:15815:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788837821.856864:0:15815:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788837821.856869:0:15815:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788837821.856877:0:15815:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788837821.857078:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837821.857086:0:15815:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788837821.857092:0:15815:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788837821.857097:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837821.857102:0:15815:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788837821.857110:0:15815:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8899c3244800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788837821.857116:0:15815:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8899c26699b8) has exports, disconnecting them 00000020:00080000:0.0:1788837821.857121:0:15815:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8899c3244800), last request at 1788837616 00000020:00000080:0.0:1788837821.857125:0:15815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeeeae 00000020:00080000:0.0:1788837821.857143:0:15815:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8899c3244800): rc 0 00000020:00000080:0.0:1788837821.857149:0:15815:0:(genops.c:885:class_export_put()) final put ffff8899c3244800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788837821.857851:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c3247800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788837821.857857:0:36:0:(genops.c:885:class_export_put()) final put ffff8899c277a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788837821.857860:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c277a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788837821.857866:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788837821.857930:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3244800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788837821.872829:0:15815:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788837821.872839:0:15815:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788837821.872844:0:15815:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788837821.872851:0:15815:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788837821.872880:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8899c3245800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788837821.874871:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788837821.875082:0:10392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788837821.875233:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788837821.875474:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff889adeb33800:6507] 0 exiting: rc = 1 00000100:00100000:1.0:1788837821.875537:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff889adf793200:6508] 1 exiting: rc = 0 00000100:00100000:2.0:1788837821.875627:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.875981:0:6510:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff889adf4f0400:6510] 1 exiting: rc = 0 00000100:00100000:1.0:1788837821.876172:0:6509:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff889adf4f1e00:6509] 0 exiting: rc = 1 00000100:00100000:1.0:1788837821.877920:0:6511:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff889adf4f1200:6511] 2 exiting: rc = 0 00000100:00100000:0.0:1788837821.878068:0:9528:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8899c27b8800:9528] 3 exiting: rc = 0 00000100:00100000:2.0:1788837821.878180:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878245:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878311:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878318:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878323:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878328:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878333:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878338:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878343:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878352:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878357:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878374:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878380:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878387:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878393:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878398:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878403:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878407:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878413:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878418:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878423:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878427:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878432:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878437:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878441:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878445:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878450:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878454:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878458:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878462:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878467:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878472:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878477:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878482:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878487:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878493:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878498:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878504:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878509:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878514:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878519:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878523:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878527:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878532:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878536:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878540:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878553:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878558:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878563:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878567:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878572:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878576:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878581:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878585:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878590:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878594:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878600:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878604:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878608:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878613:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878618:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878623:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878629:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.878634:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788837821.879883:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837821.879894:0:15815:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788837821.879900:0:15815:0:(genops.c:885:class_export_put()) final put ffff8899c3241800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788837821.879903:0:15815:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c3241800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788837821.879909:0:15815:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788837821.879954:0:15815:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ae7ed4800 1 00000020:00000080:0.0:1788837821.879960:0:15815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x57f6d4e926aeee3e 00000020:00000080:0.0:1788837821.879965:0:15815:0:(genops.c:885:class_export_put()) final put ffff8899c21e3000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788837821.880014:0:15815:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788837821.880018:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837821.880023:0:15815:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788837821.880027:0:15815:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8899c2668000) has no exports 00000020:00000080:1.0:1788837821.880807:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c21e3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788837821.913993:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837821.914009:0:15815:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788837821.914014:0:15815:0:(genops.c:885:class_export_put()) final put ffff8899c21e2000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788837821.914018:0:15815:0:(genops.c:844:class_export_destroy()) destroying export ffff8899c21e2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788837821.914024:0:15815:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788837821.914603:0:15815:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff889affb4a800 00000020:01000000:1.0:1788837821.914624:0:15815:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788837821.914638:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837821.914642:0:15815:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788837821.914646:0:15815:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff889af758b370) has no exports 00000020:00000080:1.0:1788837821.914859:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837821.914866:0:15815:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788837821.914869:0:15815:0:(genops.c:885:class_export_put()) final put ffff889afa706800/OSS_uuid 00000020:00000080:1.0:1788837821.914872:0:15815:0:(genops.c:844:class_export_destroy()) destroying export ffff889afa706800/OSS_uuid for OSS 00000020:01000000:1.0:1788837821.914876:0:15815:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788837821.914956:0:6520:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788837821.915382:0:8544:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff889ad2133a00:8544] 3 exiting: rc = 0 00000100:00100000:3.0:1788837821.915510:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff889ac8892000:8440] 1 exiting: rc = 0 00000100:00100000:3.0:1788837821.915570:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff889afa548200:8441] 2 exiting: rc = 0 00000100:00100000:3.0:1788837821.915613:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff889afa549a00:8439] 0 exiting: rc = 1 00000100:00100000:3.0:1788837821.915656:0:14078:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff889ad8752400:14078] 4 exiting: rc = 0 00000100:00100000:0.0:1788837821.916498:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916522:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916529:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916539:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916546:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916551:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916558:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916563:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916567:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916572:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916576:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916581:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916585:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916589:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916594:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916598:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916603:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916607:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916611:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916617:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916623:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916629:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916633:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916637:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916642:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916646:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916651:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916655:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916659:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916664:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916668:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916683:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916688:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916693:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916698:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916732:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916742:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916747:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916752:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916757:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916762:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916766:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916772:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916800:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916805:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916810:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916814:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916819:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916823:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916827:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916832:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916837:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916842:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916847:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916851:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916856:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916860:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916865:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916870:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916874:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916879:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916884:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916889:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.916898:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837821.917978:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff889ae7e8d200:8443] 1 exiting: rc = 0 00000100:00100000:3.0:1788837821.918857:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff889af990e200:8442] 0 exiting: rc = 1 00000100:00100000:0.0:1788837821.920164:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920175:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920182:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920187:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920193:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920198:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920203:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920220:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920225:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920230:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920235:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920240:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920299:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920305:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920310:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920315:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920321:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920326:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920331:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920335:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920340:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920345:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920351:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920356:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920362:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920367:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920371:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920376:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920380:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920385:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920389:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920393:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920398:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920403:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920408:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920413:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920418:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920423:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920427:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920431:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920436:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920440:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920509:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920516:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920522:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920526:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920531:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920536:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920540:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920546:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920552:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920556:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920561:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920566:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920570:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920575:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920579:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920583:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920588:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920592:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920597:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920601:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920606:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.920615:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788837821.927170:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff889afa49b200:8446] 2 exiting: rc = 0 00000100:00100000:0.0:1788837821.927566:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff889afa47f800:8444] 0 exiting: rc = 1 00000100:00100000:3.0:1788837821.928796:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff889afa4a0600:8445] 1 exiting: rc = 0 00000100:00100000:0.0:1788837821.928948:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.928955:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.928967:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.928974:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.928981:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.928987:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.928993:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.928999:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929005:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929011:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929016:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929029:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929058:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929064:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929069:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929075:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929080:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929086:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929091:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929096:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929102:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929108:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929114:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929119:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929125:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929132:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929138:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929144:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929150:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929156:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929161:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929167:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929174:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929179:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929185:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929203:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929210:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929216:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929222:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929228:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929233:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929238:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929243:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929259:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929265:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929271:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929276:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929288:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929293:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929299:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929305:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929311:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929317:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929324:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929330:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929335:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929340:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929346:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929351:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929356:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929361:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929367:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929372:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.929377:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.933128:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff889afa54a400:8447] 0 exiting: rc = 1 00000100:00100000:2.0:1788837821.933747:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff889afa54a200:8448] 1 exiting: rc = 0 00000100:00100000:0.0:1788837821.933981:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.933988:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.933993:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.933998:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934002:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934007:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934011:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934016:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934021:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934025:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934030:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934035:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934039:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934175:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934180:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934185:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934189:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934204:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934209:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934213:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934217:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934222:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934226:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934231:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934235:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934239:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934244:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934258:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934263:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934267:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934272:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934276:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934285:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934291:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934296:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934300:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934304:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934309:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934313:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934318:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934322:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934326:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934331:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934335:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934343:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934348:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934352:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934356:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934360:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934365:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934369:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934373:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934382:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934386:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934390:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934394:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934398:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934402:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934407:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934412:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934416:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934420:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934425:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.934434:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788837821.935727:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff889af7618c00:8449] 0 exiting: rc = 1 00000100:00100000:2.0:1788837821.936894:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff889af7616c00:8450] 1 exiting: rc = 0 00000100:00100000:0.0:1788837821.937010:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937018:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937025:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937031:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937037:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937055:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937061:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937067:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937092:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937099:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937106:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937112:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937118:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937124:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937130:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937135:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937140:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937145:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937152:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937158:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937177:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937185:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937191:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937210:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937217:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937222:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937228:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937233:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937239:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937256:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937263:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937269:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937293:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937301:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937307:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937313:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937320:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937326:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937334:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937340:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937346:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937350:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937356:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937361:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937382:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937388:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937394:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937399:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937406:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937411:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937416:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937421:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937426:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937432:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937437:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937442:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937580:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937588:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937601:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937606:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937612:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937617:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937622:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788837821.937628:0:15815:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788837821.950949:0:15815:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788837842.918736:0:16579:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788837853.281354:0:17179:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788837853.281361:0:17179:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788837853.281363:0:17179:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788837853.281486:0:17179:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff889ac409c800 00000020:01000004:3.0:1788837853.281514:0:17179:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788837853.281522:0:17179:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788837853.281537:0:17179:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff889afc3fb370) 00000020:00000080:3.0:1788837853.281553:0:17179:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788837853.390668:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788837853.393379:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788837853.396641:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788837853.397106:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788837853.397548:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788837853.397881:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788837853.398293:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788837853.398688:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788837853.399403:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788837853.399862:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788837853.400311:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788837853.401087:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788837853.404187:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788837853.404623:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788837853.404895:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788837853.405382:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788837853.405803:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788837853.406237:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788837853.406448:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788837853.407539:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788837853.407865:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788837853.408422:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788837853.408744:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788837853.409315:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788837853.409613:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788837853.409841:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788837853.410286:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788837853.410512:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788837853.412643:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788837853.413888:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788837853.414281:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788837853.414551:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788837853.414818:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788837853.415204:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788837853.418081:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788837853.419616:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788837853.420861:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788837853.421510:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788837853.421894:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788837853.422304:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788837853.422820:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788837853.423606:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788837853.424433:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788837853.425724:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788837853.430410:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788837853.430742:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788837853.437210:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788837853.440754:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788837853.442336:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788837853.442712:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788837853.443383:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788837853.443811:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1788837853.444314:0:17179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:0.0:1788837853.446474:0:17179:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788837853.446749:0:17179:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788837853.446758:0:17179:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788837853.446769:0:17179:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af0082 00000020:01000004:0.0:1788837853.446808:0:17179:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788837853.446814:0:17179:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788837853.446820:0:17179:0:(tgt_mount.c:101:server_register_mount()) register mount ffff889ac409c800 from MGS 00000020:01000004:0.0:1788837853.446823:0:17179:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788837853.446834:0:17179:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8899c364cd28) 00000020:00000080:0.0:1788837853.446844:0:17179:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788837853.446908:0:17179:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ac409c800 from MGS, refs=2 00080000:01000000:0.0:1788837853.446913:0:17179:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788837853.446917:0:17179:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af0090 00000100:00100000:0.0:1788837853.447293:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788837853.447446:0:17179:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788837853.447453:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788837853.450441:0:17179:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788837853.450452:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788837853.463275:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837853.463869:0:17179:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788837853.463877:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788837853.468413:0:17179:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788837853.468429:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788837853.470851:0:17179:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788837853.470867:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788837853.471840:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837853.471844:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837853.471846:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837853.472363:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837853.472366:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837853.472368:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837853.473269:0:17179:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788837853.478402:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788837853.481620:0:17179:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788837853.486064:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788837853.486131:0:17179:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788837853.486168:0:17179:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788837853.487180:0:17179:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788837853.487535:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837853.489065:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788837853.489075:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788837853.494047:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788837853.494066:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788837853.494814:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788837853.494822:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788837853.495842:0:17196:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788837853.496217:0:17179:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788837853.496239:0:17179:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.103@tcp' 00000020:01000004:0.0:1788837853.496240:0:17179:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788837853.496268:0:17179:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.103@tcp (typ=mgc) 00000020:00000080:0.0:1788837853.496281:0:17179:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.103@tcp (ffff8899c364b370) 00000020:00000080:0.0:1788837853.496297:0:17179:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788837853.496369:0:17179:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889af8dff800@MGC192.168.201.103@tcp: add connection 192.168.201.103@tcp at head 00010000:00010000:0.0:1788837853.496518:0:17179:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.103@tcp-0 is initialized 00000040:01000000:0.0:1788837853.496524:0:17179:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788837853.501846:0:17197:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788837853.501918:0:17179:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.103@tcp (uuid d42f6ebb-a489-4c0b-be2b-e965e16a506d) 00000020:00000080:2.0:1788837853.501941:0:17179:0:(genops.c:1385:class_connect()) connect: client d42f6ebb-a489-4c0b-be2b-e965e16a506d, cookie 0x57f6d4e926af009e 00000100:00080000:2.0:1788837853.501953:0:17179:0:(import.c:510:import_select_connection()) MGC192.168.201.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837853.501959:0:17179:0:(import.c:624:import_select_connection()) MGC192.168.201.103@tcp: import ffff889af8dff800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837853.502005:0:17179:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c3dd4e00 x1875732037007744/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837853.502035:0:17179:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d42f6ebb-a489-4c0b-be2b-e965e16a506d->MGS 00000020:01000004:2.0:1788837853.502063:0:17179:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788837853.502068:0:17179:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788837853.502082:0:17179:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8899c266cd28) 00000020:00000080:2.0:1788837853.502092:0:17179:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788837853.502450:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3647:1875732037007744:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788837853.502531:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837853.504866:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037007744 00000100:00100000:3.0:1788837853.504881:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037007744 00000100:00100000:3.0:1788837853.504924:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837853.504944:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3647:x1875732037007744:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788837853.504969:0:17194:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d42f6ebb-a489-4c0b-be2b-e965e16a506d@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:3.0:1788837853.505000:0:17194:0:(genops.c:1385:class_connect()) connect: client d42f6ebb-a489-4c0b-be2b-e965e16a506d, cookie 0x57f6d4e926af00ac 00000100:00080000:3.0:1788837853.505133:0:17194:0:(import.c:65:import_set_state_nolock()) ffff889b01ba5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837853.505225:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+5:3647:x1875732037007744:12345-0@lo:250:mount.lustre.0 Request processed in 282us (2694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837853.505235:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837853.505614:0:3647:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788837853.505623:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.103@tcp: connect to target with instance 0 00000100:00080000:0.0:1788837853.505631:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788837853.505636:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788837853.505639:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889af8dff800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788837853.505642:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788837853.505651:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788837853.505656:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3647:1875732037007744:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788837853.513066:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837853.513286:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788837853.513293:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788837853.514435:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788837853.514444:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788837853.515960:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788837853.515971:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788837853.516683:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837853.517096:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788837853.517102:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788837853.518590:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788837853.518600:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788837853.576676:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837853.577368:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788837853.577375:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788837853.578644:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788837853.578655:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788837853.579242:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788837853.579439:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788837853.579445:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788837853.581185:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788837853.581194:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788837853.583890:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788837853.584218:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788837853.584224:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788837853.586198:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788837853.586210:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788837853.587304:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788837853.587526:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788837853.587532:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788837853.588448:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788837853.588456:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788837853.612049:0:17179:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837853.613109:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788837853.613128:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788837853.615006:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788837853.615020:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788837853.616029:0:17179:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788837853.616039:0:17179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788837853.620385:0:17179:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788837853.620649:0:17179:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788837853.620656:0:17179:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788837853.620769:0:17179:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788837853.620837:0:17179:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.103@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788837853.620841:0:17179:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788837853.620843:0:17179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788837853.620844:0:17179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837853.620845:0:17179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837853.620847:0:17179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837853.620848:0:17179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837853.620849:0:17179:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788837853.620851:0:17179:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788837853.620853:0:17179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837853.620854:0:17179:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788837853.620857:0:17179:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788837853.620864:0:17179:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788837853.620865:0:17179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788837853.620866:0:17179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837853.620867:0:17179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837853.620868:0:17179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837853.620869:0:17179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837853.620870:0:17179:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788837853.620871:0:17179:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788837853.620872:0:17179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837853.620873:0:17179:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788837853.620899:0:17179:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788837853.620919:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037007872:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788837853.621016:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837853.621123:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad26f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788837853.621367:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037007872 00000100:00100000:0.0:1788837853.621374:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037007872 00000100:00100000:0.0:1788837853.621428:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837853.621437:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+5:17179:x1875732037007872:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788837853.621489:0:17195:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788837853.621503:0:17195:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788837853.621506:0:17195:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788837853.622008:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788837853.622560:0:17195:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1788837853.626371:0:17217:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788837853.626380:0:17217:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788837853.626383:0:17217:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788837853.626386:0:17217:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788837853.627000:0:17217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788837853.628309:0:17195:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788837853.628325:0:17195:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788837853.630963:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+5:17179:x1875732037007872:12345-0@lo:253:mount.lustre.0 Request processed in 9517us (9937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837853.630979:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837853.631294:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037007872:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788837853.631309:0:17179:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788837853.631312:0:17179:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788837853.631315:0:17179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788837853.631316:0:17179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837853.631317:0:17179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837853.631319:0:17179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837853.631320:0:17179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837853.631321:0:17179:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788837853.631322:0:17179:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788837853.631324:0:17179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837853.631325:0:17179:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788837853.631345:0:17179:0:(tgt_mount.c:101:server_register_mount()) register mount ffff889ac409c800 from lustre-MDT0000 10000000:01000000:2.0:1788837853.631375:0:17179:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788837853.631378:0:17179:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788837853.631382:0:17179:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8899c364b370 10000000:01000000:2.0:1788837853.631398:0:17179:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837853.631406:0:17179:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8899c364b370 from 1 10000000:01000000:2.0:1788837853.631409:0:17179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788837853.631450:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837853.631460:0:17179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837853.631469:0:17179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837853.631490:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037008000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788837853.631550:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837853.631590:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adea3be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837853.631731:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037008000 00000100:00100000:3.0:1788837853.631738:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037008000 00000100:00100000:3.0:1788837853.631829:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837853.631947:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+5:17179:x1875732037008000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788837853.631962:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837853.631978:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ad8ac6c00/0x57f6d4e926af00ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af00b3 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.632000:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ad8ac6c00/0x57f6d4e926af00ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af00b3 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.632010:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ad8ac6c00/0x57f6d4e926af00ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af00b3 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.632019:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ad8ac6c00, rc 0) 00000100:00100000:3.0:1788837853.632061:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+6:17179:x1875732037008000:12345-0@lo:101:mount.lustre.0 Request processed in 225us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837853.632068:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837853.632138:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037008000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837853.632152:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837853.632161:0:17179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837853.632209:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037008128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837853.632235:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837853.632267:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adea3be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837853.632286:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037008128 00000100:00100000:1.0:1788837853.632292:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037008128 00000100:00100000:1.0:1788837853.632322:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837853.632329:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+6:17179:x1875732037008128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837853.632417:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+6:17179:x1875732037008128:12345-0@lo:501:mount.lustre.0 Request processed in 79us (171us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788837853.632462:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037008128:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788837853.632490:0:17179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788837853.632526:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837853.632541:0:17179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837853.632548:0:17179:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff889ac409c800 10000000:01000000:2.0:1788837853.632552:0:17179:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788837853.632556:0:17179:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff889ac409c800 10000000:01000000:2.0:1788837853.632558:0:17179:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788837853.632561:0:17179:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff889ac409c800 from 1 10000000:01000000:2.0:1788837853.632563:0:17179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788837853.632578:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837853.632585:0:17179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837853.632592:0:17179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837853.632604:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037008256:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788837853.632628:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837853.632640:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adea3be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837853.632815:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037008256 00000100:00100000:3.0:1788837853.632820:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037008256 00000100:00100000:1.0:1788837853.636272:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837853.640227:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837853.640255:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+6:17179:x1875732037008256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788837853.640275:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837853.640359:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ad8ac7e00/0x57f6d4e926af00c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af00c1 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.640389:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ad8ac7e00/0x57f6d4e926af00c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af00c1 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.640401:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ad8ac7e00/0x57f6d4e926af00c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af00c1 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.640428:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ad8ac7e00, rc 0) 00000100:00100000:3.0:1788837853.640519:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+7:17179:x1875732037008256:12345-0@lo:101:mount.lustre.0 Request processed in 279us (7890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837853.640527:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837853.640893:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037008256:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837853.640912:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837853.640923:0:17179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837853.640953:0:17179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788837853.640971:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837853.640980:0:17179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac1325e00/0x57f6d4e926af00c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837853.640988:0:17179:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788837853.640992:0:17179:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837853.640997:0:17179:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff889ac409c800 10000000:01000000:2.0:1788837853.641001:0:17179:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788837853.641005:0:17179:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788837853.641008:0:17179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788837853.641031:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837853.641038:0:17179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837853.641046:0:17179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837853.641064:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037008384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788837853.641101:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837853.651850:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adea3be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837853.653637:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037008384 00000100:00100000:0.0:1788837853.653651:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037008384 00000100:00100000:0.0:1788837853.655253:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788837853.655275:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+7:17179:x1875732037008384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837853.655296:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837853.655326:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9b000/0x57f6d4e926af00d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af00cf expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.655356:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9b000/0x57f6d4e926af00d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af00cf expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.655366:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9b000/0x57f6d4e926af00d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af00cf expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.655376:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b000, rc 0) 00000100:00100000:0.0:1788837853.655460:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+8:17179:x1875732037008384:12345-0@lo:101:mount.lustre.0 Request processed in 195us (14358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837853.655468:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837853.655602:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037008384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837853.655624:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837853.655647:0:17179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837853.655752:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037008512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837853.655816:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837853.655844:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adea3be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837853.655953:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037008512 00000100:00100000:0.0:1788837853.655959:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037008512 00000100:00100000:0.0:1788837853.655988:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837853.655994:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+8:17179:x1875732037008512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837853.656126:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+9:17179:x1875732037008512:12345-0@lo:501:mount.lustre.0 Request processed in 131us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837853.656133:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837853.656259:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037008512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837853.656288:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037008640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837853.656327:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837853.656349:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adea3be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837853.656396:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037008640 00000100:00100000:0.0:1788837853.656400:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037008640 00000100:00100000:0.0:1788837853.656432:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837853.656439:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+9:17179:x1875732037008640:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837853.657232:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+9:17179:x1875732037008640:12345-0@lo:503:mount.lustre.0 Request processed in 790us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837853.657241:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788837853.657331:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037008640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837853.657712:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17218:1875732037008768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837853.657751:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837853.657814:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adea3b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837853.657906:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037008768 00000100:00100000:3.0:1788837853.657913:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037008768 00000100:00100000:3.0:1788837853.657970:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788837853.657985:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+9:17218:x1875732037008768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837853.658578:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+9:17218:x1875732037008768:12345-0@lo:502:llog_process_th.0 Request processed in 598us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837853.658586:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788837853.658730:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17218:1875732037008768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837853.658756:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837853.658767:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837853.658770:0:17218:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788837853.658812:0:17218:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788837853.658816:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788837853.658833:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8899c2668000) 00000020:00000080:2.0:1788837853.658851:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788837853.658857:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788837853.658937:0:17218:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788837853.658946:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af00e4 00000020:00000080:2.0:1788837853.659169:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788837853.659174:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837853.659178:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837853.659179:0:17218:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788837853.659182:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837853.659186:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837853.659187:0:17218:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788837853.659190:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788837853.659198:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8899c26699b8) 00000020:00000080:2.0:1788837853.659208:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788837853.659213:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788837853.659215:0:17218:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788837853.659217:0:17218:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788837853.659222:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788837853.659267:0:17218:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ac409c800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788837853.659281:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8899c266b370) 00000020:00000080:2.0:1788837853.659288:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788837853.659353:0:17218:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788837853.659359:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926af00f9 00000020:00000080:2.0:1788837853.659448:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788837853.659454:0:17218:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788837853.659459:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x57f6d4e926af0100 00080000:01000000:2.0:1788837853.659463:0:17218:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788837853.659466:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af0107 00010000:00010000:3.0:1788837853.754962:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788837853.755824:0:17218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1788837853.756184:0:17218:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788837853.757232:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff889afc3f99b8) 00000020:00000080:3.0:1788837853.757250:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788837853.757335:0:17218:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788837853.757343:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af0115 00000020:00000080:1.0:1788837853.766592:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788837853.774405:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x57f6d4e926af011c 00000020:00000080:0.0:1788837853.782302:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788837853.782319:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837853.782328:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837853.782330:0:17218:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788837853.782334:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788837853.782336:0:17218:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788837853.782337:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788837853.782339:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788837853.782341:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788837853.782344:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837853.782345:0:17218:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788837853.782347:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837853.782352:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837853.782354:0:17218:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788837853.782358:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788837853.782408:0:17218:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788837853.782427:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837853.782430:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837853.782442:0:17218:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788837853.782445:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837853.782449:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837853.782450:0:17218:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788837853.782454:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788837853.782459:0:17218:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:00000080:0.0:1788837853.782486:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788837853.782512:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8899c36499b8) 00000020:00000080:0.0:1788837853.782682:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788837853.782690:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788837853.783043:0:17218:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788837853.783050:0:17218:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788837853.783058:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af012a 00010000:00080000:0.0:1788837853.783092:0:17218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889adea42000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:0.0:1788837853.790917:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788837853.795213:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788837853.795229:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788837853.795265:0:17218:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788837853.795287:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926af0131 00000100:00080000:1.0:1788837853.795299:0:17218:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788837853.795315:0:17218:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff889adea42000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837853.795354:0:17218:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afa5f2300 x1875732037008896/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837853.795382:0:17218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788837853.795442:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837853.795447:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837853.795449:0:17218:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788837853.795452:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788837853.795455:0:17218:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788837853.795457:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788837853.795458:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788837853.795460:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788837853.795462:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837853.795463:0:17218:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788837853.795466:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788837853.795471:0:17218:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788837853.795475:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837853.795476:0:17218:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788837853.795479:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788837853.795483:0:17218:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:1.0:1788837853.795526:0:17218:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788837853.795530:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788837853.795543:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff889ae7f3cd28) 00000020:00000080:1.0:1788837853.795554:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788837853.795560:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788837853.795613:0:17218:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788837853.795619:0:17218:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788837853.795624:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af013f 00010000:00080000:1.0:1788837853.795653:0:17218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889ad114d000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:1.0:1788837853.796066:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788837853.796908:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037008896:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788837853.796981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837853.797062:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037008896 00000100:00100000:0.0:1788837853.797070:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037008896 00000100:00100000:0.0:1788837853.797122:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837853.797129:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875732037008896:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788837853.797147:0:17205:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788837853.797195:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875732037008896:12345-0@lo:38:llog_process_th.0 Request processed in 64us (212us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788837853.797202:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788837853.797240:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889adea42000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837853.797244:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788837853.797248:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037008896:0@lo:38:llog_process_th.0 00000040:01000000:1.0:1788837853.797485:0:17218:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788837853.800714:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788837853.810245:0:17218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837853.812141:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788837853.826974:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788837853.827575:0:17224:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788837853.827581:0:17224:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788837853.838837:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837853.838854:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788837853.838900:0:17218:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788837853.838922:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926af0146 00000100:00080000:3.0:1788837853.838933:0:17218:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788837853.838939:0:17218:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff889ad114d000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837853.838976:0:17218:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ad17adf80 x1875732037009024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837853.839061:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037009024:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788837853.839138:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037009024 offset 0 length 520: 4 00000100:00080000:3.0:1788837853.841234:0:17218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788837853.841355:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837853.841363:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837853.841366:0:17218:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788837853.841370:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788837853.841373:0:17218:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788837853.841374:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788837853.841376:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788837853.841377:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788837853.841380:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837853.841381:0:17218:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788837853.841384:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788837853.841388:0:17218:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788837853.841392:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837853.841393:0:17218:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788837853.841396:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788837853.841400:0:17218:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:3.0:1788837853.841425:0:17218:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788837853.841428:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788837853.841444:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff889afc3f8000) 00000020:00000080:3.0:1788837853.841466:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788837853.841471:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788837853.841574:0:17218:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788837853.841580:0:17218:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788837853.841588:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x57f6d4e926af0154 00010000:00080000:3.0:1788837853.841641:0:17218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8899c21e7000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788837853.842104:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788837853.842255:0:17218:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788837853.842269:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788837853.845499:0:17218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788837853.847018:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788837853.847272:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788837853.848811:0:17226:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788837853.848817:0:17226:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788837853.850771:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837853.850932:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788837853.850977:0:17218:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788837853.850999:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926af015b 00000100:00080000:3.0:1788837853.851020:0:17218:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788837853.851027:0:17218:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8899c21e7000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837853.851062:0:17218:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ad17aea00 x1875732037009152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837853.851089:0:17218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788837853.851179:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037009152:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788837853.851236:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037009152 offset 0 length 520: 4 00000020:01000000:3.0:1788837853.851529:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837853.851534:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837853.851536:0:17218:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788837853.851539:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837853.851542:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837853.851544:0:17218:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788837853.851547:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788837853.851549:0:17218:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788837853.851551:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837853.851552:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837853.851554:0:17218:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788837853.851556:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837853.851558:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837853.851560:0:17218:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788837853.851563:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788837853.851593:0:17218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17218:1875732037009280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837853.851651:0:17218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837853.851681:0:17218:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52240 going to sleep for 11 seconds 00000100:00100000:2.0:1788837853.853926:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037009280 00000100:00100000:2.0:1788837853.853942:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037009280 00000100:00100000:2.0:1788837853.854009:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788837853.854020:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+9:17218:x1875732037009280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837853.854197:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+9:17218:x1875732037009280:12345-0@lo:502:llog_process_th.0 Request processed in 178us (2545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837853.854212:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837853.855275:0:17218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17218:1875732037009280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788837853.855327:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837853.855345:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837853.855348:0:17218:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788837853.855353:0:17218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788837853.855635:0:17179:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788837853.855656:0:17179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788837853.855678:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.855689:0:17179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac1325200/0x57f6d4e926af00cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00d6 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837853.855706:0:17179:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ac409c800 from 1 10000000:01000000:0.0:1788837853.855709:0:17179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788837853.855745:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.855752:0:17179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.855761:0:17179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837853.855828:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037009408:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837853.855881:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837853.855914:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac9699f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837853.856171:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037009408 00000100:00100000:3.0:1788837853.856178:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037009408 00000100:00100000:3.0:1788837853.856211:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837853.856220:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+9:17179:x1875732037009408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788837853.856231:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837853.856246:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ad8ac6000/0x57f6d4e926af0169 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0162 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.856269:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ad8ac6000/0x57f6d4e926af0169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0162 expref: 10 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.856280:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ad8ac6000/0x57f6d4e926af0169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0162 expref: 10 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.856288:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ad8ac6000, rc 0) 00000100:00100000:3.0:1788837853.856326:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+10:17179:x1875732037009408:12345-0@lo:101:mount.lustre.0 Request processed in 107us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837853.856333:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837853.856636:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037009408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837853.856650:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0169 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.856658:0:17179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0169 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837853.858040:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037009536:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788837853.858103:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837853.858683:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac9699f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837853.860312:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037009536 00000100:00100000:3.0:1788837853.860323:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037009536 00000100:00100000:3.0:1788837853.860431:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788837853.860442:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+10:17179:x1875732037009536:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788837853.860465:0:17194:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788837853.860471:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788837853.860655:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+10:17179:x1875732037009536:12345-0@lo:256:mount.lustre.0 Request processed in 213us (2550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837853.860674:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788837853.860898:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037009536:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788837853.861474:0:17179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788837853.861511:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0169 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.862017:0:17179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0169 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837853.862026:0:17179:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ac409c800 from 1 10000000:01000000:0.0:1788837853.862029:0:17179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837853.862066:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.862075:0:17179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.862084:0:17179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837853.862118:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037009664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837853.862168:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837853.867181:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac9699f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837853.867389:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037009664 00000100:00100000:3.0:1788837853.867400:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037009664 00000100:00100000:3.0:1788837853.867449:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788837853.867460:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+10:17179:x1875732037009664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788837853.867476:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837853.867533:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ad8ac7200/0x57f6d4e926af0177 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0170 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.867568:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ad8ac7200/0x57f6d4e926af0177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0170 expref: 11 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.867580:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ad8ac7200/0x57f6d4e926af0177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0170 expref: 11 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.867591:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ad8ac7200, rc 0) 00000100:00100000:3.0:1788837853.867661:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+11:17179:x1875732037009664:12345-0@lo:101:mount.lustre.0 Request processed in 203us (5491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837853.867668:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788837853.868147:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037009664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837853.868170:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0177 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.868182:0:17179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0177 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837853.868282:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037009792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837853.869048:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837853.869088:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac9699f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837853.869195:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037009792 00000100:00100000:3.0:1788837853.869202:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037009792 00000100:00100000:3.0:1788837853.869234:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788837853.869241:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+11:17179:x1875732037009792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837853.869392:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+11:17179:x1875732037009792:12345-0@lo:501:mount.lustre.0 Request processed in 150us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837853.869400:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837853.869473:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037009792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837853.869590:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037009920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837853.869639:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837853.869701:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac9699f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837853.870018:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037009920 00000100:00100000:1.0:1788837853.870023:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037009920 00000100:00100000:2.0:1788837853.870103:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788837853.870125:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+11:17179:x1875732037009920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837853.870229:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+11:17179:x1875732037009920:12345-0@lo:503:mount.lustre.0 Request processed in 109us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837853.870236:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837853.870414:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037009920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837853.876484:0:17228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17228:1875732037010048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837853.876757:0:17228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837853.876849:0:17228:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac96993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837853.876931:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037010048 00000100:00100000:1.0:1788837853.876939:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037010048 00000100:00100000:1.0:1788837853.877014:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837853.877023:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+11:17228:x1875732037010048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837853.877661:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+11:17228:x1875732037010048:12345-0@lo:502:llog_process_th.0 Request processed in 636us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837853.877670:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837853.877839:0:17228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17228:1875732037010048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837853.877870:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837853.877887:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837853.877890:0:17228:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788837853.877897:0:17228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ac409c800 00000020:00000080:0.0:1788837853.877900:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788837853.877908:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837853.877911:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837853.877912:0:17228:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788837853.877915:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837853.877917:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837853.877919:0:17228:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788837853.877922:0:17228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ac409c800 00000020:00000080:0.0:1788837853.877924:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788837853.877984:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837853.877988:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837853.877989:0:17228:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788837853.877992:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837853.877994:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837853.877995:0:17228:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788837853.877998:0:17228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ac409c800 00000020:00000080:0.0:1788837853.878001:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788837853.878019:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837853.878023:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837853.878024:0:17228:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788837853.878026:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837853.878029:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837853.878030:0:17228:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788837853.878034:0:17228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ac409c800 00000020:00000080:0.0:1788837853.878036:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788837853.878075:0:17228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17228:1875732037010176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837853.881927:0:17228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837853.881998:0:17228:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac96993c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837853.882197:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037010176 00000100:00100000:2.0:1788837853.882206:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037010176 00000100:00100000:2.0:1788837853.882306:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837853.882327:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+11:17228:x1875732037010176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837853.882481:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+11:17228:x1875732037010176:12345-0@lo:502:llog_process_th.0 Request processed in 156us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837853.882500:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837853.894552:0:17228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17228:1875732037010176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837853.894604:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837853.894614:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837853.894616:0:17228:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788837853.894620:0:17228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788837853.899200:0:17179:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788837853.899248:0:17179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837853.899390:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0177 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.899461:0:17179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0177 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837853.899528:0:17179:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788837853.899532:0:17179:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff889ac409c800 10000000:01000000:3.0:1788837853.899535:0:17179:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff889ac409c800 10000000:01000000:3.0:1788837853.899539:0:17179:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788837853.899545:0:17179:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ac409c800 from 1 10000000:01000000:3.0:1788837853.899547:0:17179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788837853.899586:0:17179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.899593:0:17179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.899603:0:17179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837853.899624:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037010304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788837853.899693:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837853.899740:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837853.899806:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037010304 00000100:00100000:2.0:1788837853.899815:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037010304 00000100:00100000:2.0:1788837853.899874:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837853.899884:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+11:17179:x1875732037010304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837853.899897:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837853.899912:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac1324200/0x57f6d4e926af0185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af017e expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837853.899952:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac1324200/0x57f6d4e926af0185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af017e expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837853.899964:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac1324200/0x57f6d4e926af0185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af017e expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837853.899974:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324200, rc 0) 00000100:00100000:2.0:1788837853.900024:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17179:x1875732037010304:12345-0@lo:101:mount.lustre.0 Request processed in 141us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837853.900031:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788837853.903718:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037010304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788837853.903750:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.903764:0:17179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837853.903903:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037010432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837853.903990:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837853.904038:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837853.908834:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037010432 00000100:00100000:0.0:1788837853.908855:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037010432 00000100:00100000:0.0:1788837853.908945:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837853.908956:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17179:x1875732037010432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837853.911746:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17179:x1875732037010432:12345-0@lo:501:mount.lustre.0 Request processed in 2781us (7745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837853.911761:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788837853.911933:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037010432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837853.911999:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037010560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837853.912055:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837853.912084:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037010560 00000100:00100000:3.0:1788837853.912091:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837853.912091:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037010560 00000100:00100000:2.0:1788837853.912682:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788837853.912758:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17179:x1875732037010560:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837853.912935:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17179:x1875732037010560:12345-0@lo:503:mount.lustre.0 Request processed in 244us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837853.912943:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788837853.913682:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037010560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837853.914949:0:17233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17233:1875732037010688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837853.915022:0:17233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837853.915057:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037010688 00000100:00100000:0.0:1788837853.915063:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037010688 00000100:00100000:3.0:1788837853.915170:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788837853.915182:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17233:x1875732037010688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837853.915308:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17233:x1875732037010688:12345-0@lo:502:llog_process_th.0 Request processed in 128us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837853.915316:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788837853.915688:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac96996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837853.915799:0:17233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17233:1875732037010688:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788837853.915859:0:17233:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788837853.915875:0:17233:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8899c3648000) 00000020:00000080:0.0:1788837853.915894:0:17233:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788837853.915996:0:17233:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ac409c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788837853.916001:0:17233:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ac409c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788837853.916003:0:17233:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ac409c800 4 00010000:00080000:3.0:1788837853.916031:0:17233:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8899c3647000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788837853.919854:0:17233:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788837853.921289:0:17233:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788837853.921334:0:17233:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788837853.921345:0:17233:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x57f6d4e926af0193 00000100:00080000:3.0:1788837853.921354:0:17233:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788837853.921358:0:17233:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8899c3647000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837853.921387:0:17233:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ad17afb80 x1875732037010816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837853.922812:0:17233:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788837853.923160:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732037010816:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788837853.923233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837853.923430:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037010816 00000100:00100000:3.0:1788837853.923439:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037010816 00000100:00100000:3.0:1788837853.923480:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837853.923497:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875732037010816:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788837853.923563:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875732037010816:12345-0@lo:38:llog_process_th.0 Request processed in 73us (329us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788837853.923570:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837853.923603:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837853.923613:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c3647000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837853.923618:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788837853.923622:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732037010816:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788837853.923681:0:17233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17233:1875732037010944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837853.923725:0:17233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837853.923746:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788837853.923772:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037010944 00000100:00100000:0.0:1788837853.923798:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037010944 00000100:00100000:0.0:1788837853.923834:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788837853.923841:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17233:x1875732037010944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837853.923962:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17233:x1875732037010944:12345-0@lo:502:llog_process_th.0 Request processed in 121us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837853.924020:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788837853.924232:0:17233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17233:1875732037010944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837853.924281:0:17233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17233:1875732037011072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837853.924315:0:17233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837853.924340:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788837853.924354:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037011072 00000100:00100000:0.0:1788837853.924360:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037011072 00000100:00100000:0.0:1788837853.924393:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788837853.924400:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17233:x1875732037011072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837853.924466:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17233:x1875732037011072:12345-0@lo:502:llog_process_th.0 Request processed in 65us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837853.924475:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788837853.924484:0:17233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17233:1875732037011072:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788837853.924519:0:17233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788837853.924568:0:17179:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788837853.924589:0:17179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788837853.924607:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.924618:0:17179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6a00/0x57f6d4e926af017e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0185 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788837853.924676:0:17179:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788837853.924678:0:17179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788837853.924680:0:17179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837853.924681:0:17179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837853.924682:0:17179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837853.924683:0:17179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837853.924685:0:17179:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788837853.924686:0:17179:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788837853.924688:0:17179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837853.924690:0:17179:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788837853.924693:0:17179:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788837853.924695:0:17179:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788837853.924697:0:17179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788837853.924698:0:17179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837853.924699:0:17179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837853.924700:0:17179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837853.924701:0:17179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837853.924702:0:17179:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788837853.924703:0:17179:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788837853.924704:0:17179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837853.924705:0:17179:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788837853.924718:0:17179:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788837853.924727:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037011200:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788837853.924756:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837853.924771:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788837853.925409:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037011200 00000100:00100000:0.0:1788837853.925416:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037011200 00000100:00100000:0.0:1788837853.925454:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788837853.925462:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17179:x1875732037011200:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788837853.925485:0:17194:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788837853.925511:0:17194:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788837853.929708:0:17194:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788837853.929728:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788837853.929922:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788837853.929928:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788837853.929953:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.929973:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ad8ac6000/0x57f6d4e926af0169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0162 expref: 12 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.929981:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.930025:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ad8ac6000/0x57f6d4e926af0169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0162 expref: 12 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.930051:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ad8ac6000/0x57f6d4e926af0169 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0162 expref: 12 pid: 17195 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837853.930066:0:17216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875732037011328:0@lo:104: 00000100:00100000:3.0:1788837853.940581:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17179:x1875732037011200:12345-0@lo:253:mount.lustre.0 Request processed in 15109us (15813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837853.940596:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788837853.941972:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17179:1875732037011200:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788837853.941974:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788837853.941989:0:17179:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788837853.941992:0:17179:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788837853.941994:0:17179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788837853.941995:0:17179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837853.941996:0:17179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837853.941997:0:17179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837853.941998:0:17179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837853.942000:0:17179:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788837853.942001:0:17179:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788837853.942003:0:17179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837853.942004:0:17179:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788837853.942036:0:17216:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac9699540 going to sleep for 11 seconds 00000020:02000000:2.0:1788837853.942038:0:17179:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788837853.942077:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037011328 00000100:00100000:0.0:1788837853.942085:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037011328 00000100:00100000:0.0:1788837853.942146:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837853.942165:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:17216:x1875732037011328:12345-0@lo:104: 00010000:00010000:0.0:1788837853.942182:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0169 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837853.942253:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837853.942261:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:17216:x1875732037011328:12345-0@lo:104: Request processed in 106us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837853.942269:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788837853.942297:0:17216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875732037011328:0@lo:104: 00010000:00010000:0.0:1788837853.942316:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.945514:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837853.945530:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0169 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.945554:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b800 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837853.945559:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0169 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.945568:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0169 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837853.945576:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0169 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837853.945582:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788837853.945635:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0169 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.945642:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837853.945667:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0169 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.945674:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b800/0x57f6d4e926af0162 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0169 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.945691:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837853.945693:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837853.945694:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837853.945734:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837853.945750:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037011456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837853.945841:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837853.945916:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037011456 00000100:00100000:3.0:1788837853.945924:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037011456 00010000:00010000:3.0:1788837853.945958:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ad8ac6000/0x57f6d4e926af0169 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0162 expref: 12 pid: 17195 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837853.945988:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837853.945997:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:3650:x1875732037011456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837853.946008:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837853.946013:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ad8ac6000/0x57f6d4e926af0169 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0162 expref: 12 pid: 17195 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.946024:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ad8ac6000/0x57f6d4e926af0169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0162 expref: 12 pid: 17195 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.946037:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ad8ac6000/0x57f6d4e926af0169 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0162 expref: 12 pid: 17195 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.946053:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.946061:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788837853.946076:0:17185:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016148958s 00010000:00010000:3.0:1788837853.946081:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.946088:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.946095:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.946102:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.946113:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837853.946118:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.946126:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.946141:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.946151:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837853.946186:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+11:3650:x1875732037011456:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837853.946193:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837853.946232:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037011456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837853.946254:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.946262:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837853.946282:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af019a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788837853.993732:0:17179:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788837853.994070:0:17179:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788837853.994607:0:17241:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788837853.994743:0:17179:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788837853.994966:0:17241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1788837853.997513:0:17242:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff889ad17ad180 x1875732037011584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837853.997547:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00000040:00080000:0.0:1788837853.997908:0:17241:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:01000000:3.0:1788837853.998123:0:17179:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788837853.998162:0:17179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788837853.998643:0:17179:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788837853.998650:0:17179:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788837853.998678:0:17179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788837853.999426:0:17240:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788837853.999431:0:17240:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00080000:0.0:1788837853.999630:0:17241:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788837854.000675:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788837854.001360:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788837854.001398:0:17179:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788837854.003114:0:17179:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1788837854.005664:0:17179:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788837854.008149:0:17179:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788837854.008192:0:17179:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3bc8169b988 00100000:10000000:3.0:1788837854.008199:0:17179:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788837854.011146:0:17179:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788837854.011166:0:17179:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788837854.011187:0:17179:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788837854.011208:0:17179:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788837854.012197:0:17179:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788837854.013119:0:17179:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788837854.522978:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788837854.842106:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788837854.842114:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ac409c800 from 7 10000000:01000000:2.0:1788837854.842119:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788837854.842186:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837854.842198:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837854.842209:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837854.842234:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037011712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837854.842315:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837854.842386:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac91d8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788837854.842654:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037011712 00000100:00100000:3.0:1788837854.842663:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037011712 00000100:00100000:3.0:1788837854.842735:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837854.842745:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+11:17197:x1875732037011712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837854.842759:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837854.842828:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ad8ac7c00/0x57f6d4e926af01a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af01a1 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837854.842863:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ad8ac7c00/0x57f6d4e926af01a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af01a1 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837854.842894:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ad8ac7c00/0x57f6d4e926af01a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af01a1 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837854.843153:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ad8ac7c00, rc 0) 00000100:00100000:3.0:1788837854.843208:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17197:x1875732037011712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 464us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837854.843215:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788837854.844022:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037011712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837854.844045:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af01a8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837854.844057:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af01a8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837854.844127:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037011840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788837854.845125:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837854.845669:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c26ba0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837854.858501:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037011840 00000100:00100000:3.0:1788837854.858520:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037011840 00000100:00100000:3.0:1788837854.861496:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788837854.861521:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17197:x1875732037011840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788837854.861556:0:17194:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788837854.861586:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788837854.861591:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788837854.861741:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17197:x1875732037011840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 231us (16618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837854.861750:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788837854.871290:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037011840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788837854.872454:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788837854.872467:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af01a8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837854.872489:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af01a8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788837854.970556:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788837855.032908:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00010000:00010000:1.0:1788837855.547373:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788837855.995121:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788837856.056870:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00010000:00010000:1.0:1788837856.568965:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837857.084521:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00010000:00010000:1.0:1788837857.592909:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837858.106173:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00010000:00010000:1.0:1788837858.626098:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837859.132696:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00000100:00080000:1.0:1788837859.262108:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788837859.262119:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788837859.262122:0:38:0:(import.c:65:import_set_state_nolock()) ffff889adea42000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837859.262130:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:1.0:1788837859.262135:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788837859.262142:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff889adea42000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837859.262165:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afa5f0a80 x1875732037012096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837859.262182:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837859.262185:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837859.262188:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837859.262190:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837859.262192:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788837859.262195:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788837859.262196:0:38:0:(import.c:65:import_set_state_nolock()) ffff8899c3647000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837859.262200:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8899c3647000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837859.262208:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afa5f0e00 x1875732037012224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837859.262234:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037012096:0@lo:38:kworker.0 00000100:00100000:1.0:1788837859.262300:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837859.262345:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732037012224:0@lo:38:kworker.0 00000100:00100000:1.0:1788837859.262383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837859.262436:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037012096 00000100:00100000:0.0:1788837859.262437:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037012224 00000100:00100000:1.0:1788837859.262444:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037012096 00000100:00100000:0.0:1788837859.262444:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037012224 00000100:00100000:1.0:1788837859.262475:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837859.262475:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837859.262482:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875732037012224:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788837859.262486:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875732037012096:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788837859.262505:0:17202:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000100:00100000:3.0:1788837859.262538:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00000080:0.0:1788837859.262540:0:17202:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x57f6d4e926af01af 00000100:00100000:3.0:1788837859.262546:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3649:1875732037011968:0@lo:400:kworker.0 00000004:00100000:0.0:1788837859.262555:0:17202:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788837859.262576:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788837859.262685:0:17202:0:(import.c:65:import_set_state_nolock()) ffff889ac4e48800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837859.263144:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875732037012224:12345-0@lo:38:kworker.0 Request processed in 659us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837859.263152:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00020000:1.0:1788837859.267174:0:17205:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788837859.274014:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037011968 00000100:00100000:2.0:1788837859.274029:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037011968 00000100:00100000:2.0:1788837859.274092:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788837859.274103:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:3649:x1875732037011968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837859.274200:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:3649:x1875732037011968:12345-0@lo:400:kworker.0 Request processed in 99us (11622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837859.274208:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788837859.275483:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3649:1875732037011968:0@lo:400:kworker.0 00010000:00080000:0.0:1788837859.279610:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff889afa5f0e00 x1875732037012224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788837859.279633:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788837859.279643:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788837859.279648:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788837859.279651:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c3647000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788837859.279658:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875732037012224:0@lo:38:kworker.0 00000100:00100000:1.0:1788837859.289588:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875732037012096:12345-0@lo:38:kworker.0 Request processed in 27091us (27277us total) trans 0 rc -19/-19 00000100:00080000:0.0:1788837859.289895:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889adea42000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837859.289901:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788837859.289905:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037012096:0@lo:38:kworker.0 00000100:00100000:1.0:1788837859.290092:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:02000400:2.0:1788837859.476210:0:17485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788837859.641693:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837860.162166:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00000020:00000004:0.0:1788837860.470850:0:17537:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788837860.471153:0:17537:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788837860.665167:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837861.178001:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00000020:00000004:1.0:1788837861.440389:0:17587:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788837861.440721:0:17587:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788837861.690577:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837862.201598:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00010000:00010000:0.0:1788837862.713958:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837863.225950:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00000100:00100000:2.0:1788837863.356969:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837853/real 1788837853] req@ffff889ad17aea00 x1875732037009152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837863 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837863.357003:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889ad17aea00 x1875732037009152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837863 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837863.357013:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837853/real 1788837853] req@ffff889ad17adf80 x1875732037009024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837863 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837863.357024:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889ad17adf80 x1875732037009024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837863 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788837863.357043:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788837863.357068:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788837863.357072:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037009152:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788837863.357078:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ad114d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788837863.357083:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788837863.357086:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037009024:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788837863.357244:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788837863.357249:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788837863.357252:0:37:0:(import.c:65:import_set_state_nolock()) ffff889adea42000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837863.357258:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 476 00000100:00080000:1.0:1788837863.357263:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788837863.357270:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff889adea42000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837863.357290:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afa5f3480 x1875732037012480/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837863.357303:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837863.357305:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788837863.357306:0:37:0:(import.c:65:import_set_state_nolock()) ffff889ad114d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837863.357310:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:1.0:1788837863.357312:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788837863.357315:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff889ad114d000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837863.357336:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afa5f2a00 x1875732037012608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837863.357343:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837863.357346:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788837863.357358:0:37:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837863.357362:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:1.0:1788837863.357364:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788837863.357368:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8899c21e7000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837863.357380:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afa5f1500 x1875732037012736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837863.357417:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837863.357429:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037012352:0@lo:400:kworker.0 00000100:00100000:1.0:1788837863.357521:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837863.357591:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037012864:0@lo:400:kworker.0 00000100:00100000:1.0:1788837863.357636:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837863.357683:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037012352 00000100:00100000:1.0:1788837863.357691:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037012352 00000100:00100000:1.0:1788837863.357746:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837863.358022:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:3648:x1875732037012352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837863.358074:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:3648:x1875732037012352:12345-0@lo:400:kworker.0 Request processed in 320us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837863.358082:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837863.358119:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037012864 00000100:00100000:1.0:1788837863.358123:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037012864 00000100:00100000:1.0:1788837863.358148:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837863.358153:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037012864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837863.358184:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037012864:12345-0@lo:400:kworker.0 Request processed in 30us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837863.358190:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788837863.358221:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff889afa5f1880 x1875732037012864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837863.358241:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037012864:0@lo:400:kworker.0 00000100:00100000:1.0:1788837863.358263:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037012352:0@lo:400:kworker.0 00000100:00100000:1.0:1788837863.358275:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037012480:0@lo:38:kworker.0 00000100:00100000:1.0:1788837863.358315:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837863.358345:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037012608:0@lo:8:kworker.0 00000400:00000100:1.0:1788837863.358364:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037012608 offset 0 length 520: 4 00000100:00100000:1.0:1788837863.358380:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037012736:0@lo:8:kworker.0 00000400:00000100:1.0:1788837863.358396:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037012736 offset 0 length 520: 4 00000100:00100000:1.0:1788837863.358422:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037012480 00000100:00100000:1.0:1788837863.358426:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037012480 00000100:00100000:1.0:1788837863.358443:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837863.358447:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875732037012480:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788837863.358462:0:17206:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788837863.383657:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875732037012480:12345-0@lo:38:kworker.0 Request processed in 25200us (25332us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788837863.383682:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788837863.383865:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889adea42000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788837863.383872:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788837863.383876:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037012480:0@lo:38:kworker.0 00010000:00010000:3.0:1788837863.737162:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837864.248898:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00010000:00010000:0.0:1788837864.765261:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788837865.209656:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788837865.272984:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00010000:00010000:0.0:1788837865.786959:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837866.297287:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00010000:00010000:3.0:1788837866.808945:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837867.321028:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00010000:00010000:2.0:1788837867.832925:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837868.345841:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00000100:00080000:1.0:1788837868.474442:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788837868.474448:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788837868.474451:0:37:0:(import.c:65:import_set_state_nolock()) ffff889adea42000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837868.474460:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:1.0:1788837868.474465:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788837868.474472:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff889adea42000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837868.474501:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afa5f1f80 x1875732037013120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837868.474520:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837868.474523:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837868.474526:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837868.474529:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788837868.474575:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037012992:0@lo:400:kworker.0 00000100:00100000:1.0:1788837868.474648:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837868.474716:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037013120:0@lo:38:kworker.0 00000100:00100000:1.0:1788837868.474745:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837868.474790:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037013248:0@lo:400:kworker.0 00000100:00100000:1.0:1788837868.474819:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837868.474853:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037012992 00000100:00100000:1.0:1788837868.474861:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037012992 00000100:00100000:1.0:1788837868.474903:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837868.474912:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:3651:x1875732037012992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837868.474959:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:3651:x1875732037012992:12345-0@lo:400:kworker.0 Request processed in 48us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837868.474966:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837868.474996:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037013120 00000100:00100000:1.0:1788837868.475000:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037013120 00000100:00100000:1.0:1788837868.475016:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837868.475021:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875732037013120:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788837868.475035:0:17205:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837868.483699:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037013248 00000100:00100000:3.0:1788837868.483714:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037013248 00000100:00100000:3.0:1788837868.483801:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837868.483813:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037013248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837868.483915:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037013248:12345-0@lo:400:kworker.0 Request processed in 104us (9094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837868.483924:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837868.487626:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037012992:0@lo:400:kworker.0 00010000:00080000:3.0:1788837868.493878:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff889afa5f2680 x1875732037013248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837868.493900:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037013248:0@lo:400:kworker.0 00000100:00100000:1.0:1788837868.502093:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875732037013120:12345-0@lo:38:kworker.0 Request processed in 27062us (27338us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788837868.502106:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788837868.502431:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889adea42000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837868.502441:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837868.502446:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037013120:0@lo:38:kworker.0 00010000:00010000:0.0:1788837868.858547:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788837868.938694:0:17932:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788837868.938699:0:17932:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788837868.938700:0:17932:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788837868.939066:0:17932:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff889ac444e800 00000020:01000004:0.0:1788837868.939083:0:17932:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788837868.941353:0:17932:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788837868.941380:0:17932:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff889af99a8000) 00000020:00000080:0.0:1788837868.941402:0:17932:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788837869.038289:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788837869.039096:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788837869.040441:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788837869.041024:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788837869.045401:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788837869.045950:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788837869.046211:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788837869.046551:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788837869.046802:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788837869.047043:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788837869.047277:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788837869.047580:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788837869.047874:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788837869.048114:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788837869.050187:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788837869.054831:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788837869.055162:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788837869.056172:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788837869.056865:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788837869.057215:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788837869.057553:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788837869.058007:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788837869.062465:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788837869.065951:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788837869.066670:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788837869.068474:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788837869.069281:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788837869.069634:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788837869.070335:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788837869.070575:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788837869.071392:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788837869.074865:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788837869.075192:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788837869.075715:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788837869.077075:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788837869.077482:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788837869.078155:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788837869.078711:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788837869.079003:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788837869.079198:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788837869.081470:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1788837869.082086:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1788837869.082556:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788837869.083180:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788837869.083634:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788837869.083947:0:17932:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00080000:01000000:0.0:1788837869.091339:0:17932:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788837869.091698:0:17932:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788837869.091716:0:17932:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788837869.092018:0:17932:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926af01bd 00000020:01000004:0.0:1788837869.092028:0:17932:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788837869.092054:0:17932:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788837869.092058:0:17932:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788837869.092065:0:17932:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788837869.092097:0:17932:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788837869.092101:0:17932:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788837869.106243:0:17932:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788837869.106283:0:17932:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.103@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788837869.106288:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788837869.106290:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788837869.106291:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837869.106292:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837869.106294:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837869.106295:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837869.106296:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837869.106298:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837869.106299:0:17932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788837869.106302:0:17932:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788837869.106305:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788837869.106306:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788837869.106307:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837869.106308:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837869.106309:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837869.106310:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837869.106311:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837869.106312:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837869.106313:0:17932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788837869.106340:0:17932:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788837869.106362:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037013376:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788837869.106443:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837869.106490:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad2a76840 going to sleep for 11 seconds 00000100:00100000:2.0:1788837869.107076:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037013376 00000100:00100000:2.0:1788837869.107085:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037013376 00000100:00100000:2.0:1788837869.107133:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788837869.107142:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17932:x1875732037013376:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788837869.107171:0:17195:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788837869.107174:0:17195:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788837869.107181:0:17195:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788837869.108700:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17932:x1875732037013376:12345-0@lo:253:mount.lustre.0 Request processed in 1551us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837869.108712:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788837869.109305:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037013376:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788837869.109322:0:17932:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788837869.109325:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788837869.109327:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788837869.109328:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837869.109330:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837869.109346:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837869.109348:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837869.109349:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837869.109351:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837869.109353:0:17932:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788837869.109371:0:17932:0:(tgt_mount.c:101:server_register_mount()) register mount ffff889ac444e800 from lustre-MDT0001 10000000:01000000:1.0:1788837869.109401:0:17932:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788837869.109404:0:17932:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788837869.109411:0:17932:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8899c364b370 local copy 00010000:00010000:1.0:1788837869.109421:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837869.109534:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037013504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837869.109583:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837869.109631:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac2ba3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837869.110970:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037013504 00000100:00100000:2.0:1788837869.110982:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037013504 00000100:00100000:2.0:1788837869.111038:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788837869.111048:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17932:x1875732037013504:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837869.111172:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17932:x1875732037013504:12345-0@lo:501:mount.lustre.0 Request processed in 125us (1588us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788837869.111180:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788837869.111322:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037013504:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788837869.111344:0:17932:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788837869.111372:0:17932:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788837869.111380:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.111389:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837869.111424:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff889ac444e800 10000000:01000000:0.0:1788837869.111440:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788837869.111445:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8899c364b370 10000000:01000000:0.0:1788837869.111448:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788837869.111452:0:17932:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8899c364b370 from 1 10000000:01000000:0.0:1788837869.111455:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788837869.111484:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af01c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.111493:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af01c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.111502:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af01c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837869.111533:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037013632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837869.111567:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837869.111594:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f40900 going to sleep for 11 seconds 00000100:00100000:2.0:1788837869.113282:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037013632 00000100:00100000:2.0:1788837869.113293:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037013632 00000100:00100000:2.0:1788837869.113350:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788837869.113360:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+12:17932:x1875732037013632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837869.113374:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837869.113394:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac1324400/0x57f6d4e926af01cb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af01c4 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.113444:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac1324400/0x57f6d4e926af01cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af01c4 expref: 13 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.113456:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac1324400/0x57f6d4e926af01cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af01c4 expref: 13 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.113465:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324400, rc 0) 00000100:00100000:2.0:1788837869.113531:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+13:17932:x1875732037013632:12345-0@lo:101:mount.lustre.0 Request processed in 172us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837869.113538:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788837869.114024:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037013632:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837869.114041:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af01c4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af01cb expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.114052:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af01c4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af01cb expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837869.114074:0:17932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788837869.114082:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af01c4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af01cb expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.114090:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ba00/0x57f6d4e926af01c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af01cb expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837869.114102:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff889ac444e800 10000000:01000000:0.0:1788837869.114107:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788837869.114112:0:17932:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff889ac444e800 from 1 10000000:01000000:0.0:1788837869.114114:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788837869.114137:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.114145:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.114154:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837869.114181:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037013760:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837869.114274:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837869.114314:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f40900 going to sleep for 11 seconds 00000100:00100000:1.0:1788837869.114362:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037013760 00000100:00100000:1.0:1788837869.114367:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037013760 00000100:00100000:1.0:1788837869.114405:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788837869.114412:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+13:17932:x1875732037013760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788837869.114420:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837869.114442:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c9600/0x57f6d4e926af01d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af01d2 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.114459:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c9600/0x57f6d4e926af01d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af01d2 expref: 14 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.114468:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c9600/0x57f6d4e926af01d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af01d2 expref: 14 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.114475:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9600, rc 0) 00000100:00100000:1.0:1788837869.114505:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+14:17932:x1875732037013760:12345-0@lo:101:mount.lustre.0 Request processed in 94us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.114522:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788837869.114692:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037013760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837869.114703:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.114710:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837869.114720:0:17932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788837869.114735:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.114741:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9bc00/0x57f6d4e926af01d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af01d9 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837869.114748:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788837869.114751:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788837869.114755:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff889ac444e800 10000000:01000000:0.0:1788837869.114758:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788837869.114761:0:17932:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788837869.114763:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788837869.114817:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.114823:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.115002:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837869.115019:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037013888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837869.115048:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837869.115073:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f40900 going to sleep for 11 seconds 00000100:00100000:1.0:1788837869.117104:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037013888 00000100:00100000:1.0:1788837869.117119:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037013888 00000100:00100000:1.0:1788837869.117183:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788837869.117194:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+14:17932:x1875732037013888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788837869.117210:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837869.117241:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c8200/0x57f6d4e926af01e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af01e0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.117271:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c8200/0x57f6d4e926af01e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af01e0 expref: 15 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.117283:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c8200/0x57f6d4e926af01e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af01e0 expref: 15 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.117292:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8200, rc 0) 00000100:00100000:1.0:1788837869.117366:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+15:17932:x1875732037013888:12345-0@lo:101:mount.lustre.0 Request processed in 174us (2317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.117373:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788837869.117591:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037013888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837869.117610:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.117619:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837869.119499:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1788837869.125137:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837869.128683:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788837869.128748:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788837869.128765:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788837869.128868:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788837869.128887:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1788837869.128901:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1788837869.128920:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1788837869.128934:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788837869.128947:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788837869.128974:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1788837869.128987:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1788837869.129000:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1788837869.129012:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1788837869.129024:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788837869.129037:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788837869.129049:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1788837869.129060:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788837869.129071:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788837869.129083:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1788837869.129097:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788837869.129113:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788837869.129125:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788837869.129137:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788837869.129165:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1788837869.129172:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1788837869.129298:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037014016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837869.129369:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837869.130615:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad2a76780 going to sleep for 11 seconds 00000100:00100000:0.0:1788837869.131117:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037014016 00000100:00100000:0.0:1788837869.131127:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037014016 00000100:00100000:0.0:1788837869.131182:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788837869.131192:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+15:17932:x1875732037014016:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837869.131459:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+15:17932:x1875732037014016:12345-0@lo:501:mount.lustre.0 Request processed in 267us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837869.131467:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788837869.131634:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037014016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837869.131684:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037014144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837869.131736:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837869.131892:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac3eb0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837869.132105:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037014144 00000100:00100000:1.0:1788837869.132111:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037014144 00000100:00100000:1.0:1788837869.132138:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788837869.132144:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+15:17932:x1875732037014144:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788837869.132801:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+15:17932:x1875732037014144:12345-0@lo:503:mount.lustre.0 Request processed in 654us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.132809:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788837869.133136:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037014144:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788837869.133744:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788837869.134108:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037014272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837869.134169:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837869.134210:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac3eb09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837869.134281:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037014272 00000100:00100000:1.0:1788837869.134287:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037014272 00000100:00100000:1.0:1788837869.134331:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788837869.134340:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+15:17932:x1875732037014272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788837869.135364:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+15:17932:x1875732037014272:12345-0@lo:502:mount.lustre.0 Request processed in 1020us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.135373:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788837869.135807:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037014272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837869.136079:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788837869.136110:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1788837869.136123:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1788837869.136137:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1788837869.136149:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1788837869.136160:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1788837869.136172:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1788837869.136196:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1788837869.136209:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1788837869.136221:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1788837869.136247:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1788837869.136260:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1788837869.136272:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1788837869.136284:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1788837869.136298:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1788837869.136312:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1788837869.136324:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1788837869.136336:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1788837869.136349:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1788837869.136362:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1788837869.136375:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1788837869.136389:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1788837869.136397:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1788837869.136404:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1788837869.136411:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1788837869.136420:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1788837869.136436:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1788837869.136445:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1788837869.136452:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1788837869.136459:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1788837869.136465:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1788837869.136472:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1788837869.136479:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1788837869.136486:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1788837869.136492:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1788837869.136499:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1788837869.136505:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1788837869.136529:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1788837869.136544:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1788837869.136557:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1788837869.136580:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1788837869.136592:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1788837869.136604:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1788837869.136616:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1788837869.136652:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037014400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837869.136700:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837869.136732:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac3eb09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837869.137523:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037014400 00000100:00100000:3.0:1788837869.137537:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037014400 00000100:00100000:3.0:1788837869.138000:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788837869.138008:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+15:17932:x1875732037014400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788837869.138140:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+15:17932:x1875732037014400:12345-0@lo:502:mount.lustre.0 Request processed in 132us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837869.138147:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788837869.138184:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037014400:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788837869.138265:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1788837869.138277:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788837869.140191:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837869.140205:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837869.140207:0:17936:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788837869.140212:0:17936:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788837869.140215:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788837869.140239:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff889afc3fcd28) 00000020:00000080:3.0:1788837869.140261:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788837869.140267:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788837869.140359:0:17936:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788837869.140368:0:17936:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926af01f5 00000020:00000080:3.0:1788837869.141136:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788837869.141141:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837869.141160:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837869.141162:0:17936:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788837869.141165:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837869.141170:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837869.141172:0:17936:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788837869.141175:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788837869.141184:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff889ac848cd28) 00000020:00000080:3.0:1788837869.141198:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788837869.141202:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788837869.141204:0:17936:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788837869.141207:0:17936:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788837869.141212:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788837869.141308:0:17936:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ac444e800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788837869.141322:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff889ac8488000) 00000020:00000080:3.0:1788837869.141337:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788837869.141398:0:17936:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788837869.141404:0:17936:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926af020a 00000020:00000080:3.0:1788837869.141502:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788837869.141508:0:17936:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788837869.141525:0:17936:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x57f6d4e926af0211 00080000:01000000:3.0:1788837869.141532:0:17936:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788837869.141535:0:17936:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926af0218 00010000:00010000:3.0:1788837869.227773:0:17936:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788837869.230890:0:17936:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1788837869.233549:0:17936:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788837869.240902:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788837869.240918:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837869.240927:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837869.240929:0:17936:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788837869.240933:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837869.240939:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837869.240941:0:17936:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788837869.240944:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788837869.240950:0:17936:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:00000080:2.0:1788837869.240980:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788837869.240997:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff889ac85799b8) 00000020:00000080:2.0:1788837869.241020:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788837869.241025:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788837869.241307:0:17936:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788837869.241315:0:17936:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788837869.241323:0:17936:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926af0226 00010000:00080000:2.0:1788837869.241357:0:17936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889ac85f6800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788837869.250866:0:17936:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788837869.252155:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788837869.252169:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788837869.252211:0:17936:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788837869.252246:0:17936:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926af022d 00000100:00080000:0.0:1788837869.252258:0:17936:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788837869.252263:0:17936:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff889ac85f6800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788837869.252580:0:17936:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c44c8380 x1875732037014528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788837869.252608:0:17936:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788837869.252667:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837869.252671:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837869.252672:0:17936:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788837869.252675:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788837869.252678:0:17936:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788837869.252679:0:17936:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788837869.252681:0:17936:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788837869.252682:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788837869.252684:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837869.252686:0:17936:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788837869.252689:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837869.252693:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837869.252694:0:17936:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788837869.252698:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788837869.252727:0:17936:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788837869.252741:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837869.252744:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837869.252746:0:17936:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788837869.252748:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788837869.252749:0:17936:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788837869.252751:0:17936:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788837869.252752:0:17936:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788837869.252754:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788837869.252756:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837869.252757:0:17936:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788837869.252759:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788837869.252769:0:17936:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788837869.252773:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837869.252796:0:17936:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788837869.252801:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788837869.252805:0:17936:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:0.0:1788837869.252828:0:17936:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788837869.252831:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788837869.252844:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff889af99acd28) 00000020:00000080:0.0:1788837869.252857:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788837869.252862:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1788837869.253196:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037014528:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788837869.253284:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788837869.253417:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788837869.253422:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788837869.253434:0:38:0:(import.c:65:import_set_state_nolock()) ffff889adea42000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837869.253440:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 485 00000100:00080000:2.0:1788837869.253443:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788837869.253448:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff889adea42000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837869.253475:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c3dd5c00 x1875732037014656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837869.253496:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837869.253499:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788837869.253502:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837869.253504:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788837869.253543:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837869.253553:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037014784:0@lo:400:kworker.0 00000100:00100000:2.0:1788837869.253589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837869.253721:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037014656:0@lo:38:kworker.0 00000100:00100000:3.0:1788837869.253747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837869.254043:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037014528 00000100:00100000:0.0:1788837869.254051:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037014528 00000100:00100000:0.0:1788837869.254140:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037014656 00000100:00100000:0.0:1788837869.254144:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037014656 00000100:00100000:0.0:1788837869.254159:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837869.254166:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875732037014528:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788837869.254188:0:17206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:0.0:1788837869.254219:0:17206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926af023b 00000004:00100000:0.0:1788837869.254246:0:17206:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788837869.254252:0:17206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000004:00080000:0.0:1788837869.254363:0:17936:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788837869.254370:0:17936:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788837869.254376:0:17936:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926af0242 00010000:00080000:0.0:1788837869.254406:0:17936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889ad9a71000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:0.0:1788837869.254730:0:17936:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1788837869.254851:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037014784 00000100:00100000:2.0:1788837869.254856:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037014784 00000100:00100000:2.0:1788837869.254902:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837869.254910:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037014784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837869.254973:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037014784:12345-0@lo:400:kworker.0 Request processed in 64us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837869.254981:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788837869.255026:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8899c3dd7800 x1875732037014784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837869.255040:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037014784:0@lo:400:kworker.0 00000040:01000000:1.0:1788837869.260589:0:17936:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788837869.260972:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788837869.262952:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837869.263543:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788837869.263662:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:2.0:1788837869.265368:0:17206:0:(import.c:65:import_set_state_nolock()) ffff889af8dbf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837869.265548:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875732037014528:12345-0@lo:38:llog_process_th.0 Request processed in 11377us (12261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837869.265566:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837869.265598:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837869.265605:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875732037014656:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788837869.265661:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875732037014656:12345-0@lo:38:kworker.0 Request processed in 56us (11913us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788837869.265668:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837869.265749:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788837869.265757:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889adea42000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837869.265761:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788837869.265765:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037014656:0@lo:38:kworker.0 00000100:00100000:1.0:1788837869.265813:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788837869.265819:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788837869.265827:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788837869.265832:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788837869.265834:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ac85f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788837869.265843:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037014528:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788837869.266000:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00000080:2.0:1788837869.266906:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788837869.266919:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788837869.266956:0:17936:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788837869.266977:0:17936:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926af0249 00000100:00080000:2.0:1788837869.266984:0:17936:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837869.266989:0:17936:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff889ad9a71000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837869.267013:0:17936:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c3dd6a00 x1875732037015040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837869.267031:0:17936:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788837869.267055:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837869.267060:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788837869.267063:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837869.267065:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788837869.267185:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837869.267189:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837869.267192:0:17936:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788837869.267195:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788837869.267198:0:17936:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788837869.267199:0:17936:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788837869.267201:0:17936:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788837869.267202:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788837869.267204:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837869.267206:0:17936:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788837869.267209:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788837869.267213:0:17936:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788837869.267236:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837869.267237:0:17936:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788837869.267241:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788837869.267246:0:17936:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:2.0:1788837869.267269:0:17936:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788837869.267272:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788837869.267283:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff889ac857cd28) 00000020:00000080:2.0:1788837869.267295:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788837869.267300:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788837869.267375:0:17936:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788837869.267382:0:17936:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788837869.267388:0:17936:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x57f6d4e926af0257 00010000:00080000:2.0:1788837869.267414:0:17936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889af8dbc000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.103@tcp at head 00000040:00080000:3.0:1788837869.267564:0:17941:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788837869.267569:0:17941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00010000:00010000:2.0:1788837869.267838:0:17936:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788837869.267905:0:17936:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788837869.267922:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788837869.268339:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037015040:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788837869.268401:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037015040 offset 0 length 520: 4 00000100:00100000:0.0:1788837869.268771:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037014912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837869.268853:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837869.268936:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037014912 00000100:00100000:2.0:1788837869.268945:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037014912 00000100:00100000:2.0:1788837869.268994:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837869.269003:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875732037014912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788837869.269039:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788837869.269110:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875732037014912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837869.269117:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837869.269652:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037014912:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788837869.271283:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788837869.271488:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788837869.271633:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788837869.272327:0:17943:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788837869.272339:0:17943:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788837869.273361:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788837869.273373:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788837869.273413:0:17936:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788837869.273449:0:17936:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926af025e 00000100:00080000:3.0:1788837869.273461:0:17936:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788837869.273467:0:17936:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff889af8dbc000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837869.273504:0:17936:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ad17ac380 x1875732037015168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788837869.273662:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037015168:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788837869.273728:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037015168 offset 0 length 520: 4 00000100:00080000:3.0:1788837869.274077:0:17936:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788837869.274141:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837869.274146:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837869.274148:0:17936:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788837869.274151:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837869.274155:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837869.274156:0:17936:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788837869.274159:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788837869.274161:0:17936:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788837869.274163:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837869.274165:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837869.274166:0:17936:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788837869.274169:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788837869.274170:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837869.274171:0:17936:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788837869.274175:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00080000:0.0:1788837869.274308:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788837869.274313:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788837869.274316:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788837869.274318:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1788837869.274425:0:17936:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788837869.274430:0:17936:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788837869.274431:0:17936:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788837869.274435:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1788837869.274656:0:17932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788837869.274686:0:17932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788837869.274708:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.274719:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9ae00/0x57f6d4e926af01e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af01e7 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837869.274727:0:17932:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ac444e800 from 1 10000000:01000000:0.0:1788837869.274730:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788837869.274759:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.274767:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.274799:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837869.274817:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037015296:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837869.274864:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837869.274886:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0e9a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788837869.275078:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037015296 00000100:00100000:1.0:1788837869.275086:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037015296 00000100:00100000:1.0:1788837869.275138:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788837869.275147:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+15:17932:x1875732037015296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788837869.275174:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837869.275187:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af026c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0265 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.275368:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af026c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0265 expref: 16 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.275380:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af026c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0265 expref: 16 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.275388:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8400, rc 0) 00000100:00100000:1.0:1788837869.275443:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+16:17932:x1875732037015296:12345-0@lo:101:mount.lustre.0 Request processed in 297us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.275450:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788837869.275634:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037015296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837869.275656:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af026c expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.275665:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af026c expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837869.276409:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037015424:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788837869.276468:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837869.276544:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0e9a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837869.277144:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037015424 00000100:00100000:3.0:1788837869.277151:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037015424 00000100:00100000:3.0:1788837869.277254:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788837869.277264:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+16:17932:x1875732037015424:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788837869.277283:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788837869.277301:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788837869.277304:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788837869.277806:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+16:17932:x1875732037015424:12345-0@lo:256:mount.lustre.0 Request processed in 542us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837869.277815:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788837869.277911:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037015424:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788837869.278561:0:17932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788837869.278583:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af026c expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.278595:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af026c expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837869.278604:0:17932:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ac444e800 from 1 10000000:01000000:0.0:1788837869.278606:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837869.278640:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.278648:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.278658:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837869.278677:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037015552:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837869.278725:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837869.279798:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0e9a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837869.279901:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037015552 00000100:00100000:2.0:1788837869.279908:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037015552 00000100:00100000:2.0:1788837869.279950:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788837869.279970:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+16:17932:x1875732037015552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837869.279984:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837869.279999:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac1325000/0x57f6d4e926af027a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0273 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.280024:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac1325000/0x57f6d4e926af027a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0273 expref: 17 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.280035:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac1325000/0x57f6d4e926af027a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0273 expref: 17 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.280044:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1325000, rc 0) 00000100:00100000:2.0:1788837869.280112:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17932:x1875732037015552:12345-0@lo:101:mount.lustre.0 Request processed in 144us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837869.280119:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837869.283829:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037015552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837869.283863:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af027a expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.283877:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af027a expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837869.284036:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788837869.284096:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037015680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837869.284156:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837869.284193:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0e9ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837869.284444:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037015680 00000100:00100000:3.0:1788837869.284452:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037015680 00000100:00100000:3.0:1788837869.284496:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788837869.284505:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17932:x1875732037015680:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837869.284625:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17932:x1875732037015680:12345-0@lo:501:mount.lustre.0 Request processed in 121us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837869.284633:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837869.284926:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037015680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837869.284957:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037015808:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837869.285008:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837869.285033:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0e9ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837869.285203:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037015808 00000100:00100000:2.0:1788837869.285208:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037015808 00000100:00100000:2.0:1788837869.285247:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788837869.285254:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17932:x1875732037015808:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837869.285354:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17932:x1875732037015808:12345-0@lo:503:mount.lustre.0 Request processed in 100us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837869.285361:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788837869.285460:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037015808:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788837869.285853:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788837869.285945:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037015936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837869.285982:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837869.286002:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0e9a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837869.286816:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037015936 00000100:00100000:2.0:1788837869.286825:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037015936 00000100:00100000:2.0:1788837869.286857:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788837869.286865:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17932:x1875732037015936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837869.286979:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17932:x1875732037015936:12345-0@lo:502:mount.lustre.0 Request processed in 114us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837869.286995:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788837869.287361:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037015936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788837869.287728:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788837869.287756:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788837869.287817:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788837869.287836:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788837869.287850:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1788837869.287865:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788837869.287876:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1788837869.287887:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1788837869.287899:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788837869.287911:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1788837869.287923:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1788837869.287952:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037016064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837869.287999:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837869.288027:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0e9a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788837869.288096:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037016064 00000100:00100000:2.0:1788837869.288101:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037016064 00000100:00100000:2.0:1788837869.288136:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788837869.288144:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17932:x1875732037016064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837869.288238:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17932:x1875732037016064:12345-0@lo:502:mount.lustre.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837869.288245:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788837869.288418:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037016064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788837869.288523:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1788837869.288531:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788837869.291402:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837869.291533:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837869.291535:0:17945:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788837869.291545:0:17945:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ac444e800 00000020:00000080:2.0:1788837869.291548:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788837869.291556:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837869.291559:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837869.291560:0:17945:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788837869.291562:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837869.291565:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837869.291566:0:17945:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788837869.291569:0:17945:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ac444e800 00000020:00000080:2.0:1788837869.291571:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788837869.291670:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837869.291674:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837869.291675:0:17945:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788837869.291678:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837869.291680:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837869.291681:0:17945:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788837869.291684:0:17945:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ac444e800 00000020:00000080:2.0:1788837869.291686:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788837869.293180:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837869.293193:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837869.293195:0:17945:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788837869.293199:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837869.293202:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837869.293204:0:17945:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788837869.293208:0:17945:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ac444e800 00000020:00000080:2.0:1788837869.293210:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788837869.293752:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837869.293756:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837869.293758:0:17945:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788837869.293761:0:17945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1788837869.296165:0:17932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788837869.296203:0:17932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788837869.297535:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af027a expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.297551:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af027a expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837869.297617:0:17932:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788837869.297621:0:17932:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff889ac444e800 10000000:01000000:1.0:1788837869.297624:0:17932:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff889ac444e800 10000000:01000000:1.0:1788837869.297629:0:17932:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788837869.297634:0:17932:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ac444e800 from 1 10000000:01000000:1.0:1788837869.297637:0:17932:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788837869.297678:0:17932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.297692:0:17932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.297704:0:17932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837869.297729:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037016192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788837869.297812:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837869.297860:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f40840 going to sleep for 11 seconds 00000100:00100000:2.0:1788837869.298748:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037016192 00000100:00100000:2.0:1788837869.298759:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037016192 00000100:00100000:2.0:1788837869.298838:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788837869.298848:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17932:x1875732037016192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837869.298862:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837869.298877:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac1324a00/0x57f6d4e926af0288 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0281 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.298903:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac1324a00/0x57f6d4e926af0288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0281 expref: 18 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.298913:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac1324a00/0x57f6d4e926af0288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0281 expref: 18 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.298922:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324a00, rc 0) 00000100:00100000:2.0:1788837869.298980:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17932:x1875732037016192:12345-0@lo:101:mount.lustre.0 Request processed in 132us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837869.298986:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788837869.299040:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037016192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837869.299081:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.299090:0:17932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837869.300656:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788837869.300943:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837869.302577:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788837869.302623:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1788837869.302638:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1788837869.302653:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1788837869.302666:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1788837869.302679:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1788837869.302691:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1788837869.302704:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1788837869.302718:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1788837869.302746:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1788837869.302762:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1788837869.302793:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1788837869.302811:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1788837869.302824:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1788837869.302838:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1788837869.302852:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1788837869.302866:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1788837869.302880:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1788837869.302892:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1788837869.302904:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1788837869.302916:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1788837869.302927:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1788837869.302938:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1788837869.302950:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1788837869.302973:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1788837869.303000:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1788837869.303015:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1788837869.303027:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1788837869.303049:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1788837869.303055:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788837869.305708:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037016320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837869.305801:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837869.305855:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac68fa180 going to sleep for 11 seconds 00000100:00100000:2.0:1788837869.305888:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037016320 00000100:00100000:2.0:1788837869.305895:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037016320 00000100:00100000:2.0:1788837869.305941:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788837869.305949:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17932:x1875732037016320:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837869.317630:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17932:x1875732037016320:12345-0@lo:501:mount.lustre.0 Request processed in 11670us (11818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837869.317647:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788837869.318669:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037016320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837869.318727:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037016448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837869.318809:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837869.318852:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac68fa180 going to sleep for 11 seconds 00000100:00100000:1.0:1788837869.319185:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037016448 00000100:00100000:1.0:1788837869.319192:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037016448 00000100:00100000:1.0:1788837869.319256:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788837869.319266:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17932:x1875732037016448:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788837869.320284:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17932:x1875732037016448:12345-0@lo:503:mount.lustre.0 Request processed in 1015us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.320293:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788837869.321326:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037016448:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788837869.324016:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788837869.324623:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037016576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837869.324711:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837869.324772:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac68fa840 going to sleep for 11 seconds 00000100:00100000:1.0:1788837869.325690:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037016576 00000100:00100000:1.0:1788837869.325702:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037016576 00000100:00100000:1.0:1788837869.325756:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788837869.325765:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17932:x1875732037016576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788837869.327655:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17932:x1875732037016576:12345-0@lo:502:mount.lustre.0 Request processed in 1880us (2934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.327669:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788837869.327820:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037016576:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837869.328056:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788837869.328961:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1788837869.328978:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1788837869.328990:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1788837869.329002:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1788837869.329013:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1788837869.329025:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1788837869.329037:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1788837869.329049:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1788837869.330378:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1788837869.331185:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1788837869.331211:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1788837869.331238:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1788837869.331254:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1788837869.331269:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1788837869.331283:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1788837869.331309:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1788837869.331325:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1788837869.331339:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1788837869.331353:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1788837869.331367:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1788837869.331381:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1788837869.331394:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1788837869.331421:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1788837869.332172:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1788837869.332213:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1788837869.333623:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1788837869.333645:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1788837869.333657:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1788837869.333670:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1788837869.333686:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1788837869.333702:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1788837869.333729:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1788837869.333742:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1788837869.333754:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1788837869.334916:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1788837869.334950:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1788837869.334965:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1788837869.334978:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1788837869.334992:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1788837869.335006:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1788837869.335038:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1788837869.335055:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1788837869.336719:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1788837869.336773:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1788837869.337546:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1788837869.337560:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1788837869.338714:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1788837869.338812:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037016704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837869.338893:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837869.338937:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac68fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1788837869.338964:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037016704 00000100:00100000:2.0:1788837869.338971:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037016704 00000100:00100000:2.0:1788837869.339021:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788837869.339031:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17932:x1875732037016704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837869.340288:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17932:x1875732037016704:12345-0@lo:502:mount.lustre.0 Request processed in 1252us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837869.340297:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788837869.340365:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037016704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837869.341948:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1788837869.341988:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1788837869.342038:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037016832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837869.344613:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837869.344664:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac68fa840 going to sleep for 11 seconds 00000100:00100000:1.0:1788837869.344801:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037016832 00000100:00100000:1.0:1788837869.344810:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037016832 00000100:00100000:1.0:1788837869.344862:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788837869.344881:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17932:x1875732037016832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788837869.345009:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17932:x1875732037016832:12345-0@lo:502:mount.lustre.0 Request processed in 130us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.345016:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788837869.345693:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037016832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837869.345800:0:17932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788837869.345814:0:17932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788837869.349694:0:17950:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788837869.349713:0:17950:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff889ae7f399b8) 00000020:00000080:1.0:1788837869.349736:0:17950:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788837869.349845:0:17950:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ac444e800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788837869.349850:0:17950:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ac444e800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788837869.349853:0:17950:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ac444e800 3 00010000:00080000:1.0:1788837869.349885:0:17950:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889af8e31000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:1.0:1788837869.358766:0:17950:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788837869.358986:0:17950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788837869.359033:0:17950:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788837869.359048:0:17950:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x57f6d4e926af0296 00000100:00080000:1.0:1788837869.359058:0:17950:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788837869.359236:0:17950:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff889af8e31000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837869.359273:0:17950:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afa5f1c00 x1875732037016960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837869.359300:0:17950:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788837869.359337:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837869.359341:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837869.359344:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837869.359347:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788837869.359605:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875732037016960:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788837869.359678:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837869.359965:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037016960 00000100:00100000:1.0:1788837869.359973:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037016960 00000100:00100000:1.0:1788837869.360023:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837869.360030:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875732037016960:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788837869.360055:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:1.0:1788837869.360367:0:17200:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x57f6d4e926af029d 00000004:00100000:1.0:1788837869.360382:0:17200:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788837869.362061:0:17200:0:(import.c:65:import_set_state_nolock()) ffff889af8e37000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837869.362176:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875732037016960:12345-0@lo:38:llog_process_th.0 Request processed in 2140us (2493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.362188:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788837869.363484:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff889afa5f1c00 x1875732037016960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837869.363499:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837869.363508:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788837869.363517:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788837869.363522:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788837869.363526:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889af8e31000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788837869.363533:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875732037016960:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788837869.372324:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00000040:00080000:3.0:1788837869.386105:0:17950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1788837869.386611:0:17932:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788837869.386643:0:17932:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788837869.386662:0:17932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.386674:0:17932:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c8e00/0x57f6d4e926af0281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0288 expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788837869.386724:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788837869.386726:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788837869.386728:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837869.386729:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837869.386730:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837869.386732:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837869.386733:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788837869.386735:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837869.386736:0:17932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788837869.386740:0:17932:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788837869.386742:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788837869.386744:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788837869.386745:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837869.386746:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837869.386747:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837869.386748:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837869.386749:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788837869.386750:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837869.386751:0:17932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788837869.386814:0:17932:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788837869.386849:0:17932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037017088:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788837869.386922:0:17932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837869.386961:0:17932:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac68fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1788837869.386987:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037017088 00000100:00100000:2.0:1788837869.386993:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037017088 00000100:00100000:2.0:1788837869.387044:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788837869.387053:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17932:x1875732037017088:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788837869.387093:0:17195:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788837869.387107:0:17195:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788837869.388663:0:17180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788837869.389196:0:17195:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788837869.389217:0:17195:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788837869.389419:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788837869.389433:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788837869.389454:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.389473:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ad8ac7c00/0x57f6d4e926af01a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af01a1 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.389482:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af026c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0265 expref: 18 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.389490:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.389536:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af026c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0265 expref: 18 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.389550:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af026c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0265 expref: 18 pid: 17194 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837869.389565:0:17216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875732037017216:0@lo:104: 00000100:00100000:0.0:1788837869.389630:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837869.389681:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ad8ac7c00/0x57f6d4e926af01a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af01a1 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.389690:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ad8ac7c00/0x57f6d4e926af01a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af01a1 expref: 18 pid: 17192 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837869.389698:0:17216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875732037017344:0@lo:104: 00000100:00100000:0.0:1788837869.389720:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837869.389744:0:17216:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa520900 going to sleep for 11 seconds 00000100:00100000:0.0:1788837869.389981:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037017216 00000100:00100000:0.0:1788837869.389988:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037017216 00000100:00100000:0.0:1788837869.390022:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037017344 00000100:00100000:0.0:1788837869.390025:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037017344 00000100:00100000:0.0:1788837869.390040:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837869.390049:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+4:17216:x1875732037017216:12345-0@lo:104: 00010000:00010000:0.0:1788837869.390062:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af026c expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.390194:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837869.390200:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+4:17216:x1875732037017216:12345-0@lo:104: Request processed in 152us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837869.390216:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837869.390246:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788837869.390252:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:17216:x1875732037017344:12345-0@lo:104: 00010000:00010000:0.0:1788837869.390260:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af01a8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.390295:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788837869.390300:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:17216:x1875732037017344:12345-0@lo:104: Request processed in 49us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837869.390305:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788837869.390323:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837869.390329:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af026c expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.390335:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b600 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837869.390339:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af026c expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.390349:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af026c expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837869.390355:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af026c expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837869.390361:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788837869.390387:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af026c expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.390393:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837869.390591:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788837869.390809:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17932:x1875732037017088:12345-0@lo:253:mount.lustre.0 Request processed in 3755us (3885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837869.390818:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788837869.390873:0:17932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17932:1875732037017088:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788837869.390886:0:17932:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788837869.390890:0:17932:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788837869.390892:0:17932:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788837869.390893:0:17932:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837869.390895:0:17932:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837869.390896:0:17932:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837869.390897:0:17932:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837869.390898:0:17932:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788837869.390900:0:17932:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837869.390902:0:17932:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788837869.390916:0:17932:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788837869.391379:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af026c expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.391387:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af026c expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.392173:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837869.392177:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837869.392179:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837869.392229:0:17216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875732037017216:0@lo:104: 00000100:00100000:0.0:1788837869.392244:0:17216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875732037017344:0@lo:104: 00010000:00010000:0.0:1788837869.392267:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837869.393280:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037017472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837869.393351:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837869.393585:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037017472 00000100:00100000:0.0:1788837869.393593:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037017472 00010000:00010000:0.0:1788837869.393627:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af026c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0265 expref: 18 pid: 17194 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837869.393664:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837869.393672:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:3651:x1875732037017472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837869.393685:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837869.393690:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af026c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0265 expref: 18 pid: 17194 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.393701:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af026c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0265 expref: 18 pid: 17194 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.393738:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af026c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0265 expref: 18 pid: 17194 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837869.393755:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837869.393809:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:3651:x1875732037017472:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837869.393817:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837869.393849:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037017472:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837869.401193:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837869.401199:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837869.401201:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837869.403472:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af01a8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.403493:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325800 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837869.403506:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af01a8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.403517:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af01a8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837869.403525:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af01a8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837869.403531:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788837869.403579:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af01a8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.403586:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837869.403608:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af01a8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.403615:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac1325800/0x57f6d4e926af01a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af01a8 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837869.403633:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837869.403636:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837869.403638:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837869.403735:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037017600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837869.403818:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837869.404702:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037017600 00000100:00100000:1.0:1788837869.404713:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037017600 00010000:00010000:1.0:1788837869.404752:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ad8ac7c00/0x57f6d4e926af01a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af01a1 expref: 17 pid: 17192 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837869.404809:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788837869.404818:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:3648:x1875732037017600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837869.404831:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837869.404842:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ad8ac7c00/0x57f6d4e926af01a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af01a1 expref: 17 pid: 17192 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.404856:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ad8ac7c00/0x57f6d4e926af01a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af01a1 expref: 17 pid: 17192 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.404872:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ad8ac7c00/0x57f6d4e926af01a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af01a1 expref: 17 pid: 17192 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.404886:0:17187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.404908:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788837869.404923:0:17187:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016148958s 00010000:00010000:1.0:1788837869.404927:0:17187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.404934:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.404940:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.404946:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.404951:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837869.404955:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.404962:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.404979:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.404989:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837869.405042:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+16:3648:x1875732037017600:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.405050:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788837869.405989:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.406000:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837869.406006:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9a200/0x57f6d4e926af02a4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837869.406052:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037017600:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1788837869.413921:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1788837869.414646:0:17958:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788837869.415159:0:17958:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788837869.416187:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788837869.417460:0:17959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1875732037017728:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788837869.417538:0:17959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837869.417577:0:17959:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4dc9a80 going to sleep for 11 seconds 00000040:01000000:0.0:1788837869.417883:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788837869.417923:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788837869.418359:0:17932:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788837869.418367:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788837869.418408:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788837869.421212:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037017728 00000100:00100000:1.0:1788837869.421236:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037017728 00000100:00100000:1.0:1788837869.421303:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788837869.421314:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17959:x1875732037017728:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788837869.421940:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17959:x1875732037017728:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 625us (4399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.421949:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788837869.422016:0:17959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1875732037017728:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788837869.422053:0:17959:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788837869.422529:0:17959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1875732037017856:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788837869.422580:0:17959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837869.422612:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037017856 00000100:00100000:1.0:1788837869.422616:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037017856 00000100:00100000:1.0:1788837869.422642:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837869.422648:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17959:x1875732037017856:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788837869.422766:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17959:x1875732037017856:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 117us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.422773:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837869.422809:0:17959:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7eaec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837869.422824:0:17959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1875732037017856:0@lo:1000:lod0001_rec0000.0 00000020:00080000:3.0:1788837869.423365:0:17957:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788837869.423369:0:17957:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:2.0:1788837869.423713:0:17958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788837869.423773:0:17958:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788837869.424293:0:17932:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1788837869.424588:0:17959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17959:1875732037017984:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788837869.424643:0:17959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837869.424696:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037017984 00000100:00100000:1.0:1788837869.424701:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037017984 00000100:00100000:1.0:1788837869.424742:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837869.424750:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17959:x1875732037017984:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788837869.424807:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17959:x1875732037017984:12345-0@lo:900:lod0001_rec0000.0 Request processed in 57us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.424814:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837869.424833:0:17959:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac4dc9a80 going to sleep for 11 seconds 00010000:00080000:1.0:1788837869.424853:0:17959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff889afa5f0000 x1875732037017984/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788837885 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837869.424865:0:17959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17959:1875732037017984:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788837869.424910:0:17959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1875732037018112:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788837869.426886:0:17959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837869.426949:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037018112 00000100:00100000:1.0:1788837869.426956:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037018112 00000100:00100000:1.0:1788837869.426997:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837869.427005:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17959:x1875732037018112:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788837869.427215:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17959:x1875732037018112:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 210us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837869.427234:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837869.427257:0:17959:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7eae9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837869.427283:0:17959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17959:1875732037018112:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788837869.427336:0:17959:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837869.427613:0:17932:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788837869.427933:0:17932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788837869.429163:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788837869.430679:0:17932:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:1.0:1788837869.432364:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788837869.432435:0:17959:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788837869.432439:0:17959:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1788837869.433286:0:17932:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788837869.437381:0:17932:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788837869.437428:0:17932:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa3bc81473988 00100000:10000000:0.0:1788837869.437436:0:17932:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788837869.438392:0:17932:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788837869.438493:0:17932:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788837869.438513:0:17932:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788837869.438532:0:17932:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788837869.440764:0:17932:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788837869.441020:0:17932:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788837869.883717:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837870.408349:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00000040:00080000:3.0:1788837870.459616:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788837870.905522:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788837871.109185:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788837871.109205:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ac444e800 from 8 10000000:01000000:3.0:1788837871.109211:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788837871.109264:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837871.109296:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837871.109308:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837871.109335:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037018240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837871.109420:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837871.109717:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0e9ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837871.122239:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037018240 00000100:00100000:1.0:1788837871.122258:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037018240 00000100:00100000:1.0:1788837871.122331:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788837871.122341:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+16:17197:x1875732037018240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837871.122357:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837871.122377:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926af02b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af02ab expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837871.122417:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926af02b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af02ab expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837871.122428:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926af02b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af02ab expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837871.122435:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9a00, rc 0) 00000100:00100000:1.0:1788837871.122515:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17197:x1875732037018240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (13095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837871.122522:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788837871.125004:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037018240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837871.125034:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af02b2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837871.125047:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af02b2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837871.125136:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037018368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788837871.125213:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837871.125252:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6c0b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788837871.125359:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037018368 00000100:00100000:0.0:1788837871.125373:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037018368 00000100:00100000:0.0:1788837871.125435:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788837871.125444:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17197:x1875732037018368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788837871.125462:0:17195:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788837871.125477:0:17195:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788837871.125480:0:17195:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788837871.125573:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17197:x1875732037018368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837871.125580:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788837871.126216:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037018368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788837871.126265:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788837871.126273:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af02b2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837871.126282:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af02b2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837871.126291:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788837871.126294:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ac409c800 from 8 10000000:01000000:2.0:1788837871.126297:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788837871.126321:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837871.126330:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837871.126346:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837871.126361:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037018496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837871.126405:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837871.126428:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6c0b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788837871.127005:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037018496 00000100:00100000:0.0:1788837871.127012:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037018496 00000100:00100000:0.0:1788837871.127050:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788837871.127068:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17197:x1875732037018496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837871.127079:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837871.127093:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af02c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af02b9 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837871.127115:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af02c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af02b9 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837871.127124:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af02c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af02b9 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837871.127133:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b200, rc 0) 00000100:00100000:0.0:1788837871.127187:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17197:x1875732037018496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837871.127207:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788837871.127347:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037018496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837871.127363:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af02c0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837871.127372:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af02c0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837871.127437:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037018624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788837871.127472:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837871.127510:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adea1c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837871.127769:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037018624 00000100:00100000:2.0:1788837871.127790:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037018624 00000100:00100000:2.0:1788837871.127816:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788837871.127823:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17197:x1875732037018624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788837871.127835:0:17195:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788837871.127850:0:17195:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788837871.127853:0:17195:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788837871.127929:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17197:x1875732037018624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837871.127947:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788837871.128534:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037018624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788837871.128596:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788837871.128604:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af02c0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837871.128613:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af02c0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837871.422600:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00000040:00080000:3.0:1788837871.491072:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788837871.931305:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837872.440900:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00010000:00010000:2.0:1788837872.952979:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837873.469407:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00010000:00010000:2.0:1788837873.976917:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837874.495983:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 0 seconds 00000100:00080000:1.0:1788837874.616928:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788837874.616934:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788837874.616938:0:38:0:(import.c:65:import_set_state_nolock()) ffff889adea42000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837874.616950:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff889adea42000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837874.616974:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889afa5f3480 x1875732037018880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837874.617000:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837874.617004:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837874.617006:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837874.617010:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837874.617037:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837874.617039:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837874.617042:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837874.617044:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788837874.617080:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037019264:0@lo:400:kworker.0 00000100:00100000:1.0:1788837874.617155:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837874.617209:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837874.617216:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037018752:0@lo:400:kworker.0 00000100:00100000:1.0:1788837874.617245:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837874.617276:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037018880:0@lo:38:kworker.0 00000100:00100000:1.0:1788837874.617318:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837874.617346:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037019008:0@lo:400:kworker.0 00000100:00100000:1.0:1788837874.617370:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837874.617388:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837874.617393:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037019136:0@lo:400:kworker.0 00000100:00100000:1.0:1788837874.617413:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837874.617441:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037019264 00000100:00100000:1.0:1788837874.617448:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037019264 00000100:00100000:1.0:1788837874.617493:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037019008 00000100:00100000:1.0:1788837874.617497:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037019008 00000100:00100000:1.0:1788837874.617513:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837874.617521:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037019264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837874.617568:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037019264:12345-0@lo:400:kworker.0 Request processed in 47us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837874.617576:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837874.617593:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837874.617599:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037019008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837874.617629:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037019008:12345-0@lo:400:kworker.0 Request processed in 30us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837874.617635:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837874.617651:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037018880 00000100:00100000:1.0:1788837874.617654:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037018880 00000100:00100000:1.0:1788837874.617664:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037019136 00000100:00100000:1.0:1788837874.617666:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037019136 00000100:00100000:1.0:1788837874.617680:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788837874.617685:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875732037018880:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788837874.617708:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:1.0:1788837874.617741:0:17205:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926af02c7 00000004:00100000:1.0:1788837874.617755:0:17205:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788837874.617760:0:17205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:1.0:1788837874.617870:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889afa5f0a80 x1875732037019008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837874.617883:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037019008:0@lo:400:kworker.0 00010000:00080000:1.0:1788837874.617911:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889afa5f3100 x1875732037019264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837874.617928:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037019264:0@lo:400:kworker.0 00000100:00100000:2.0:1788837874.618516:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037019392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837874.618556:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837874.618586:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037018752 00000100:00100000:2.0:1788837874.618590:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037018752 00000100:00100000:2.0:1788837874.618623:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788837874.618629:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:3648:x1875732037018752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837874.618660:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:3648:x1875732037018752:12345-0@lo:400:kworker.0 Request processed in 31us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837874.618673:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788837874.618701:0:17206:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788837874.618708:0:17206:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788837874.618817:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037019392 00000100:00100000:2.0:1788837874.618821:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037019392 00000100:00100000:2.0:1788837874.618903:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837874.618910:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875732037019136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837874.618945:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875732037019136:12345-0@lo:400:kworker.0 Request processed in 36us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837874.618952:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837874.618964:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837874.618970:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037019392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788837874.618991:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788837874.619022:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037019392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837874.619028:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837874.619057:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037019392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837874.619141:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037019136:0@lo:400:kworker.0 00000100:00100000:1.0:1788837874.619164:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037018752:0@lo:400:kworker.0 00000100:00080000:1.0:1788837874.622447:0:17205:0:(import.c:65:import_set_state_nolock()) ffff889af8e36800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837874.622544:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875732037018880:12345-0@lo:38:kworker.0 Request processed in 4855us (5223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837874.622555:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788837874.622720:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788837874.622730:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788837874.622735:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788837874.622737:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889adea42000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788837874.622760:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004420776c): req@ffff889ad17ad180 x1875732037011584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837874.622794:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037018880:0@lo:38:kworker.0 00000100:00100000:1.0:1788837874.622935:0:17242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837874.622957:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 11 seconds 00000100:00100000:1.0:1788837874.622973:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037011584 00000100:00100000:1.0:1788837874.622978:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037011584 00000100:00100000:1.0:1788837874.623009:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788837874.623018:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17242:x1875732037011584:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788837874.623081:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17242:x1875732037011584:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 63us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837874.623088:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788837874.623103:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837874.623113:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037019520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837874.623148:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837874.623179:0:17242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1875732037011584:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788837874.623209:0:17242:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788837874.623238:0:17242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1875732037019648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788837874.623266:0:17242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837874.623295:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0401e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837874.623315:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037019520 00000100:00100000:1.0:1788837874.623319:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037019520 00000100:00100000:1.0:1788837874.623346:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037019648 00000100:00100000:1.0:1788837874.623349:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037019648 00000100:00100000:1.0:1788837874.623361:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788837874.623366:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3651:x1875732037019520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788837874.623383:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788837874.623417:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3651:x1875732037019520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837874.623422:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788837874.623433:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837874.623438:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17242:x1875732037019648:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788837874.623520:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17242:x1875732037019648:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837874.623525:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837874.623553:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037019520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837874.623576:0:17242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1875732037019648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788837874.623634:0:17242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1875732037019776:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788837874.623656:0:17242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837874.623669:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0401e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837874.623679:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037019776 00000100:00100000:1.0:1788837874.623682:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037019776 00000100:00100000:1.0:1788837874.623698:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788837874.623703:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17242:x1875732037019776:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788837874.623745:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17242:x1875732037019776:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 41us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837874.623760:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788837874.623817:0:17242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17242:1875732037019776:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788837874.623851:0:17242:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837874.625871:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788837874.625949:0:17242:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:1.0:1788837874.625954:0:17242:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788837875.005800:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788837875.294518:0:18203:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1788837875.450381:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788837876.025909:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788837876.405616:0:18255:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788837876.406660:0:18255:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788837877.050830:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788837877.283614:0:18306:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788837877.285585:0:18306:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788837878.084172:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788837878.500645:0:18354:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7a217690 20000000:00000080:1.0:1788837878.500664:0:18354:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff889aec345400 uarg=0000000000000000 20000000:01000000:1.0:1788837878.500704:0:18354:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788837878.500712:0:18354:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788837878.500717:0:18354:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788837878.501947:0:18355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788837878.502235:0:18354:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788837878.510446:0:18354:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788837878.510847:0:18354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837878.510867:0:18354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ad8ac7200/0x57f6d4e926af0177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0170 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837878.510875:0:18354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac1325000/0x57f6d4e926af027a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0273 expref: 17 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837878.510884:0:18354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837878.510925:0:18354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac1325000/0x57f6d4e926af027a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0273 expref: 17 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837878.510941:0:18354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ac1325000/0x57f6d4e926af027a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0273 expref: 17 pid: 17195 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837878.510976:0:18354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18354:1875732037019904:0@lo:104: 00000100:00100000:1.0:1788837878.511049:0:18354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837878.511123:0:18354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ad8ac7200/0x57f6d4e926af0177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0170 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837878.511132:0:18354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ad8ac7200/0x57f6d4e926af0177 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0170 expref: 17 pid: 17194 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837878.511140:0:18354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18354:1875732037020032:0@lo:104: 00000100:00100000:1.0:1788837878.511163:0:18354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837878.511186:0:18354:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af745be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837878.511450:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037019904 00000100:00100000:0.0:1788837878.511459:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037019904 00000100:00100000:0.0:1788837878.511491:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037020032 00000100:00100000:0.0:1788837878.511494:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037020032 00000100:00100000:0.0:1788837878.511509:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837878.511517:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+4:18354:x1875732037019904:12345-0@lo:104: 00010000:00010000:0.0:1788837878.511529:0:17184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af027a expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.511591:0:17184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837878.511598:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+4:18354:x1875732037019904:12345-0@lo:104: Request processed in 82us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837878.511606:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837878.511623:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837878.511629:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:18354:x1875732037020032:12345-0@lo:104: 00010000:00010000:0.0:1788837878.511636:0:17184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0177 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.511670:0:17184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788837878.511676:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:18354:x1875732037020032:12345-0@lo:104: Request processed in 48us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837878.511682:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788837878.511698:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837878.511704:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af027a expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.511712:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a600 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837878.511716:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af027a expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.511737:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af027a expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837878.511745:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af027a expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837878.511751:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837878.511803:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af027a expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.511810:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837878.511829:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af027a expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.511836:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a600/0x57f6d4e926af0273 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af027a expref: -99 pid: 17932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.511851:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837878.511854:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0177 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.511860:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a800 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837878.511864:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0177 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.511870:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0177 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837878.511877:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0177 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837878.511889:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837878.511903:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0177 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.511909:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837878.511926:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0177 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.511933:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c1a9a800/0x57f6d4e926af0170 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0177 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.511945:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837878.511947:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837878.511949:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837878.511954:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837878.511965:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037020160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837878.511996:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837878.512053:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037020288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837878.512090:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837878.512122:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037020160 00000100:00100000:0.0:1788837878.512126:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037020160 00010000:00010000:0.0:1788837878.512147:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac1325000/0x57f6d4e926af027a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0273 expref: 18 pid: 17195 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837878.512168:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037020288 00000100:00100000:0.0:1788837878.512172:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037020288 00010000:00010000:0.0:1788837878.512183:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ad8ac7200/0x57f6d4e926af0177 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0170 expref: 19 pid: 17194 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837878.512210:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837878.512217:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+19:3651:x1875732037020160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837878.512228:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837878.512234:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac1325000/0x57f6d4e926af027a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0273 expref: 19 pid: 17195 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.512245:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac1325000/0x57f6d4e926af027a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0273 expref: 19 pid: 17195 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.512262:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837878.512477:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+19:3651:x1875732037020160:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837878.512485:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837878.512499:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837878.512505:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:3648:x1875732037020288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837878.512513:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837878.512517:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ad8ac7200/0x57f6d4e926af0177 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0170 expref: 18 pid: 17194 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.512527:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ad8ac7200/0x57f6d4e926af0177 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0170 expref: 18 pid: 17194 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.512539:0:17187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.512546:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.512568:0:17187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.512575:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.512583:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.512589:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.512596:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837878.512600:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.512608:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.512616:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837878.512624:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837878.512652:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:3648:x1875732037020288:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837878.512658:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837878.512699:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037020288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837878.512725:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037020160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837878.514073:0:18354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac1325000/0x57f6d4e926af027a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0273 expref: 17 pid: 17195 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837878.514089:0:18354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18354:1875732037019904:0@lo:104: 00010000:00010000:1.0:1788837878.514101:0:18354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ad8ac7200/0x57f6d4e926af0177 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0170 expref: 16 pid: 17194 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837878.514110:0:18354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18354:1875732037020032:0@lo:104: 00010000:00010000:1.0:1788837878.514128:0:18354:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837878.514137:0:18354:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837878.514144:0:18354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837878.514164:0:18354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af02ce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837878.712897:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837863/real 1788837863] req@ffff889afa5f2a00 x1875732037012608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837878 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837878.712929:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889afa5f2a00 x1875732037012608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837878 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837878.712938:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837863/real 1788837863] req@ffff889afa5f1500 x1875732037012736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837878 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837878.712948:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889afa5f1500 x1875732037012736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837878 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788837878.712967:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ad114d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788837878.712992:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788837878.712996:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037012608:0@lo:8:kworker.0 00000100:00080000:2.0:1788837878.713002:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788837878.713008:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788837878.713011:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037012736:0@lo:8:kworker.0 00000100:00080000:1.0:1788837878.713556:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837878.713560:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788837878.713563:0:37:0:(import.c:65:import_set_state_nolock()) ffff889ad114d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837878.713568:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:1.0:1788837878.713573:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788837878.713580:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff889ad114d000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837878.713600:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c27be300 x1875732037020544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837878.713611:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837878.713613:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788837878.713615:0:37:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837878.713618:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:1.0:1788837878.713620:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788837878.713623:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8899c21e7000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837878.713633:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c27bc380 x1875732037020672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837878.713663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837878.713667:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837878.713669:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837878.713672:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788837878.713710:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037020800:0@lo:400:kworker.0 00000100:00100000:1.0:1788837878.713769:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837878.713824:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837878.713830:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037020928:0@lo:400:kworker.0 00000100:00100000:1.0:1788837878.713856:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837878.713888:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037020800 00000100:00100000:1.0:1788837878.713895:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037020800 00000100:00100000:1.0:1788837878.713940:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837878.713949:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037020800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837878.713995:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037020800:12345-0@lo:400:kworker.0 Request processed in 47us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837878.714002:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837878.714024:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037020928 00000100:00100000:1.0:1788837878.714027:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037020928 00000100:00100000:1.0:1788837878.714050:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788837878.714068:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037020928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837878.714101:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037020928:12345-0@lo:400:kworker.0 Request processed in 44us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837878.714107:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788837878.714146:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037020928:0@lo:400:kworker.0 00010000:00080000:1.0:1788837878.714157:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8899c27bc000 x1875732037020800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837878.714166:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037020800:0@lo:400:kworker.0 00000100:00100000:2.0:1788837878.714242:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037020416:0@lo:400:kworker.0 00000100:00100000:2.0:1788837878.714271:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837878.714303:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837878.714309:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732037021056:0@lo:400:kworker.0 00000100:00100000:2.0:1788837878.714344:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837878.714370:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037021056 00000100:00100000:2.0:1788837878.714382:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037021056 00000100:00100000:2.0:1788837878.714408:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837878.714415:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732037021056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837878.714451:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732037021056:12345-0@lo:400:kworker.0 Request processed in 37us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837878.714457:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788837878.714483:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8899c27bdf80 x1875732037021056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837878.714492:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732037021056:0@lo:400:kworker.0 00000100:00100000:2.0:1788837878.714512:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037020544:0@lo:8:kworker.0 00000400:00000100:2.0:1788837878.714536:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037020544 offset 0 length 520: 4 00000100:00100000:2.0:1788837878.714559:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037020672:0@lo:8:kworker.0 00000400:00000100:2.0:1788837878.714575:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037020672 offset 0 length 520: 4 00000100:00100000:1.0:1788837878.714684:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037020416 00000100:00100000:1.0:1788837878.714688:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037020416 00000100:00100000:1.0:1788837878.714729:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837878.714736:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875732037020416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837878.714772:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875732037020416:12345-0@lo:400:kworker.0 Request processed in 36us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837878.714803:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788837878.714869:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037020416:0@lo:400:kworker.0 00010000:00010000:2.0:1788837879.097030:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837879.740329:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037021184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837879.740396:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837879.740899:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837869/real 1788837869] req@ffff889ad17ac380 x1875732037015168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837879 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837879.740923:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889ad17ac380 x1875732037015168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837879 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837879.740978:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837869/real 1788837869] req@ffff8899c3dd6a00 x1875732037015040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837879 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837879.741012:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8899c3dd6a00 x1875732037015040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837879 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788837879.741027:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788837879.741053:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788837879.741057:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037015168:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788837879.741062:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ad9a71000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788837879.741067:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788837879.741070:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037015040:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788837879.741113:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837879.741116:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788837879.741118:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837879.741121:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788837879.741136:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837879.741139:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788837879.741141:0:38:0:(import.c:65:import_set_state_nolock()) ffff889ad9a71000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837879.741146:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 486 00000100:00080000:2.0:1788837879.741150:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788837879.741156:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff889ad9a71000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837879.741172:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c3dd5f80 x1875732037021824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837879.741184:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837879.741193:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788837879.741195:0:38:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837879.741198:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 486 00000100:00080000:2.0:1788837879.741201:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788837879.741204:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff889af8dbc000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837879.741215:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c3dd4a80 x1875732037021952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788837879.741241:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037021696:0@lo:400:kworker.0 00000100:00100000:2.0:1788837879.741274:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837879.741297:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837879.741303:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037021568:0@lo:400:kworker.0 00000100:00100000:2.0:1788837879.741326:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837879.741353:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037021568 00000100:00100000:2.0:1788837879.741359:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037021568 00000100:00100000:2.0:1788837879.741400:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788837879.741407:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037021568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837879.741451:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037021568:12345-0@lo:400:kworker.0 Request processed in 44us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837879.741458:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788837879.741482:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037021824:0@lo:8:kworker.0 00000400:00000100:2.0:1788837879.741507:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037021824 offset 0 length 520: 4 00000100:00100000:2.0:1788837879.741528:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037021952:0@lo:8:kworker.0 00000400:00000100:2.0:1788837879.741543:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875732037021952 offset 0 length 520: 4 00010000:00080000:2.0:1788837879.741574:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8899c3dd4380 x1875732037021568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837879.741598:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037021568:0@lo:400:kworker.0 00000100:00100000:1.0:1788837879.751680:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037021184 00000100:00100000:1.0:1788837879.751694:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037021184 00000100:00100000:1.0:1788837879.751738:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037021696 00000100:00100000:1.0:1788837879.751741:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037021696 00000100:00100000:1.0:1788837879.751757:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837879.751765:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875732037021184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788837879.751833:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788837879.751917:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875732037021184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (11520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837879.751924:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837879.751941:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788837879.751946:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037021696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837879.751974:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037021696:12345-0@lo:400:kworker.0 Request processed in 28us (10700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837879.751980:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788837879.752001:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037021312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837879.752035:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837879.752074:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037022080:0@lo:400:kworker.0 00000100:00100000:1.0:1788837879.752096:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837879.752114:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837879.752120:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037021440:0@lo:400:kworker.0 00000100:00100000:1.0:1788837879.752153:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837879.752187:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037021312 00000100:00100000:1.0:1788837879.752190:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037021312 00000100:00100000:1.0:1788837879.752206:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788837879.752211:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037021312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788837879.752226:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788837879.752257:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037021312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837879.752262:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788837879.752279:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037022080 00000100:00100000:1.0:1788837879.752282:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037022080 00000100:00100000:1.0:1788837879.752303:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837879.752308:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037022080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837879.752346:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037022080:12345-0@lo:400:kworker.0 Request processed in 38us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837879.752352:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837879.752368:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037021440 00000100:00100000:1.0:1788837879.752371:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037021440 00000100:00100000:1.0:1788837879.752390:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788837879.752395:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+16:3650:x1875732037021440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837879.752418:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+16:3650:x1875732037021440:12345-0@lo:400:kworker.0 Request processed in 23us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837879.752423:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788837879.752462:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037021440:0@lo:400:kworker.0 00000100:00100000:1.0:1788837879.752476:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037021312:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1788837879.752487:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8899c3dd4700 x1875732037022080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837879.752502:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037022080:0@lo:400:kworker.0 00000100:00100000:1.0:1788837879.752923:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037021696:0@lo:400:kworker.0 00000100:00100000:1.0:1788837879.752936:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037021184:0@lo:41:osp-pre-1-0.0 10000000:01000000:3.0:1788837880.120889:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837880.120898:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ac444e800 from 13 10000000:01000000:3.0:1788837880.120905:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837880.120954:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837880.120967:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837880.120979:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837880.121005:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037022208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837880.121090:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837880.121136:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adea1cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837880.121214:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037022208 00000100:00100000:2.0:1788837880.121222:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037022208 00000100:00100000:2.0:1788837880.121357:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788837880.121367:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+16:17197:x1875732037022208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837880.121381:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837880.121395:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac1325a00/0x57f6d4e926af02dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af02d5 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837880.121418:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac1325a00/0x57f6d4e926af02dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af02d5 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837880.121428:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac1325a00/0x57f6d4e926af02dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af02d5 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837880.121438:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1325a00, rc 0) 00000100:00100000:2.0:1788837880.122602:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17197:x1875732037022208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1231us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837880.122612:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1788837880.123351:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837880.129532:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037022208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837880.129575:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af02dc expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837880.129590:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af02dc expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837880.129686:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037022336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837880.129750:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837880.129874:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad2a76a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837880.132411:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037022336 00000100:00100000:2.0:1788837880.132427:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037022336 00000100:00100000:3.0:1788837880.136665:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788837880.136679:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17197:x1875732037022336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837880.136879:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17197:x1875732037022336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (7128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837880.136887:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788837880.137100:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037022336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837880.137155:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037022464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837880.137206:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837880.137253:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad2a76a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837880.137360:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037022464 00000100:00100000:2.0:1788837880.137366:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037022464 00000100:00100000:2.0:1788837880.137402:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788837880.137409:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17197:x1875732037022464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837880.137514:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17197:x1875732037022464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837880.137533:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788837880.137679:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037022464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788837880.144999:0:18423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788837880.145211:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788837880.145235:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788837880.145258:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af02dc expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837880.145270:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af02dc expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837880.145280:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788837880.145283:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ac409c800 from 13 10000000:01000000:1.0:1788837880.145286:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788837880.145325:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837880.145333:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837880.145344:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837880.145368:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037022592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788837880.145436:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837880.145470:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af745bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837880.146843:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037022592 00000100:00100000:3.0:1788837880.146855:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037022592 00000100:00100000:2.0:1788837880.147103:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788837880.147116:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+17:17197:x1875732037022592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837880.147131:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837880.147149:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac1325800/0x57f6d4e926af02ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af02e3 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837880.147175:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac1325800/0x57f6d4e926af02ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af02e3 expref: 18 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837880.147186:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac1325800/0x57f6d4e926af02ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af02e3 expref: 18 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837880.147194:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1325800, rc 0) 00000100:00100000:2.0:1788837880.147279:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17197:x1875732037022592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837880.147286:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788837880.148049:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037022592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837880.148089:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af02ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837880.148100:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af02ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837880.148183:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037022720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837880.148227:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837880.148661:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af745bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837880.148837:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037022720 00000100:00100000:3.0:1788837880.148844:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037022720 00000100:00100000:3.0:1788837880.148883:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788837880.148892:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17197:x1875732037022720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837880.149030:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17197:x1875732037022720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837880.149048:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788837880.149947:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037022720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837880.149997:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037022848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837880.150073:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837880.150112:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af745bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837880.151176:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037022848 00000100:00100000:3.0:1788837880.151188:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037022848 00000100:00100000:3.0:1788837880.151311:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788837880.151324:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17197:x1875732037022848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837880.151463:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:17197:x1875732037022848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837880.151470:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788837880.151631:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037022848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788837880.169575:0:18424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788837880.169773:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788837880.169832:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788837880.169846:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af02ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837880.169857:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af02ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1788837880.259711:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788837881.153008:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788837881.729824:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788837882.173824:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837883.217158:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837884.219690:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837884.857120:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1788837884.858285:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788837884.858292:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788837884.858294:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788837884.858297:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788837884.858349:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037023232:0@lo:400:kworker.0 00000100:00100000:1.0:1788837884.858536:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837884.858590:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837884.858596:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037023104:0@lo:400:kworker.0 00000100:00100000:1.0:1788837884.858639:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837884.858688:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037023104 00000100:00100000:1.0:1788837884.858696:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037023104 00000100:00100000:1.0:1788837884.858739:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788837884.858747:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037023104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837884.858813:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037023104:12345-0@lo:400:kworker.0 Request processed in 66us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837884.858821:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788837884.858862:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037023104:0@lo:400:kworker.0 00000100:00100000:2.0:1788837884.860016:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837884.860032:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037023360:0@lo:400:kworker.0 00000100:00100000:2.0:1788837884.860077:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837884.860318:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037022976:0@lo:400:kworker.0 00000100:00100000:3.0:1788837884.860402:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837884.860428:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837884.860436:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037023488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837884.860458:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837884.860486:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037023360 00000100:00100000:3.0:1788837884.860491:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037023360 00000100:00100000:3.0:1788837884.860521:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037023488 00000100:00100000:3.0:1788837884.860525:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037023488 00000100:00100000:3.0:1788837884.860541:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837884.860549:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037023360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837884.860586:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037023360:12345-0@lo:400:kworker.0 Request processed in 38us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837884.860593:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837884.860609:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837884.860614:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037023488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788837884.860650:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788837884.860685:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037023488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837884.860691:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837884.860742:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037023488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837884.860807:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037023232 00000100:00100000:3.0:1788837884.860811:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037023232 00000100:00100000:3.0:1788837884.860839:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837884.860845:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037023232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837884.860883:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037023232:12345-0@lo:400:kworker.0 Request processed in 38us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837884.860898:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788837884.860964:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8899c44c8a80 x1875732037023232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837884.860975:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037023232:0@lo:400:kworker.0 00000100:00100000:3.0:1788837884.860987:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837884.860992:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037023616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837884.861016:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837884.861038:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037023616 00000100:00100000:3.0:1788837884.861042:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037023616 00000100:00100000:3.0:1788837884.861062:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788837884.861068:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037023616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837884.861084:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788837884.861136:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037023616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837884.861143:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788837884.862276:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037023616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837884.862321:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037023360:0@lo:400:kworker.0 00000100:00100000:3.0:1788837884.862348:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037022976 00000100:00100000:3.0:1788837884.862353:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037022976 00000100:00100000:3.0:1788837884.862459:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788837884.862468:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:3650:x1875732037022976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837884.862522:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:3650:x1875732037022976:12345-0@lo:400:kworker.0 Request processed in 55us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837884.862529:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788837884.862576:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037022976:0@lo:400:kworker.0 00000100:00080000:0.0:1788837884.862672:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788837884.862677:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788837884.862680:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788837884.862688:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788837884.862721:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837884.862756:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037023744:0@lo:400:kworker.0 00000100:00100000:0.0:1788837884.862810:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837884.862838:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037023744 00000100:00100000:0.0:1788837884.862842:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037023744 00000100:00100000:0.0:1788837884.862868:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788837884.862874:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037023744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837884.862909:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037023744:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837884.862915:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788837884.862942:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8899c44c8000 x1875732037023744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837884.862962:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037023744:0@lo:400:kworker.0 00010000:00010000:3.0:1788837885.250990:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788837885.692954:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788837886.268670:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788837886.636207:0:18702:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788837886.636212:0:18702:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788837886.636214:0:18702:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788837886.636331:0:18702:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff889ae7d4a800 00000020:01000004:2.0:1788837886.636347:0:18702:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788837886.636360:0:18702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788837886.636381:0:18702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff889ac857b370) 00000020:00000080:2.0:1788837886.636397:0:18702:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788837886.763025:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788837886.764116:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788837886.766219:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788837886.766900:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788837886.767478:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788837886.767717:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788837886.768454:0:18702:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788837886.782579:0:18702:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788837886.782772:0:18702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788837886.782962:0:18702:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788837886.782974:0:18702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x57f6d4e926af02f8 00000020:01000004:3.0:1788837886.782982:0:18702:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788837886.783001:0:18702:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788837886.783004:0:18702:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788837886.783009:0:18702:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788837886.783013:0:18702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788837886.783024:0:18702:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff889ac848b370) 00000020:00000080:3.0:1788837886.783035:0:18702:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788837886.792175:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788837886.798505:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788837886.798518:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788837886.800910:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788837886.800938:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788837886.807005:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788837886.807027:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788837886.809608:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837886.811891:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788837886.811905:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788837886.817047:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788837886.817061:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788837886.847091:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837886.847612:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788837886.847619:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788837886.858627:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788837886.858650:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788837886.860149:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788837886.860160:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788837886.862527:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788837886.862742:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788837886.862749:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788837886.863506:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788837886.863513:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788837886.950208:0:18702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788837886.953004:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788837886.953017:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788837886.966073:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788837886.966094:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788837886.966711:0:18702:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788837886.966739:0:18702:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788837886.966746:0:18702:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788837886.999992:0:18702:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788837887.000038:0:18702:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.103@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788837887.000044:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788837887.000046:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788837887.000047:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837887.000048:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837887.000049:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837887.000050:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837887.000052:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837887.000053:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837887.000055:0:18702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788837887.000058:0:18702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788837887.000060:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788837887.000061:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788837887.000062:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837887.000063:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837887.000064:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837887.000065:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837887.000066:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837887.000067:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837887.000068:0:18702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788837887.000093:0:18702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788837887.000114:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037023872:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788837887.001761:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.001836:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 11 seconds 00000100:00100000:0.0:1788837887.002026:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037023872 00000100:00100000:0.0:1788837887.002035:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037023872 00000100:00100000:0.0:1788837887.002095:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788837887.002105:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:18702:x1875732037023872:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788837887.002163:0:17192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788837887.002166:0:17192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788837887.002169:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788837887.002593:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:18702:x1875732037023872:12345-0@lo:253:mount.lustre.0 Request processed in 489us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837887.002601:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788837887.002745:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037023872:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788837887.002759:0:18702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788837887.002762:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788837887.002763:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788837887.002765:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837887.002766:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837887.002767:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837887.002768:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837887.002770:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788837887.002772:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837887.002801:0:18702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788837887.002823:0:18702:0:(tgt_mount.c:101:server_register_mount()) register mount ffff889ae7d4a800 from lustre-OST0000 10000000:01000000:1.0:1788837887.002866:0:18702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788837887.002869:0:18702:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788837887.002878:0:18702:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8899c364b370 local copy 00010000:00010000:1.0:1788837887.002887:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837887.002991:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837887.003030:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.003060:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af745ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837887.007455:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037024000 00000100:00100000:0.0:1788837887.007475:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037024000 00000100:00100000:0.0:1788837887.007564:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788837887.007575:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:18702:x1875732037024000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837887.007711:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:18702:x1875732037024000:12345-0@lo:501:mount.lustre.0 Request processed in 137us (4679us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788837887.007719:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788837887.008043:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024000:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788837887.008068:0:18702:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788837887.008095:0:18702:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788837887.008105:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.008115:0:18702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837887.008179:0:18702:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff889ae7d4a800 10000000:01000000:1.0:1788837887.008184:0:18702:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788837887.008189:0:18702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788837887.008192:0:18702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788837887.008196:0:18702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788837887.008199:0:18702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788837887.008234:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.008242:0:18702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.008252:0:18702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837887.008270:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788837887.008308:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.008355:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af745ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837887.008554:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037024128 00000100:00100000:0.0:1788837887.008561:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037024128 00000100:00100000:0.0:1788837887.008599:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788837887.008606:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+18:18702:x1875732037024128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837887.008615:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837887.008628:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af030d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0306 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837887.008649:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af030d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0306 expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837887.008659:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9aa00/0x57f6d4e926af030d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0306 expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837887.008667:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9aa00, rc 0) 00000100:00100000:0.0:1788837887.008702:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+19:18702:x1875732037024128:12345-0@lo:101:mount.lustre.0 Request processed in 96us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837887.008708:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788837887.008961:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788837887.008975:0:18702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af030d expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.008984:0:18702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af030d expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788837887.010224:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788837887.011048:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837887.026992:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788837887.027048:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788837887.027062:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788837887.027073:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788837887.027085:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788837887.027099:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788837887.027296:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788837887.027304:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788837887.027492:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837887.027557:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.027601:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 11 seconds 00000100:00100000:2.0:1788837887.027765:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037024256 00000100:00100000:2.0:1788837887.027797:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037024256 00000100:00100000:0.0:1788837887.028030:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788837887.028042:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+19:18702:x1875732037024256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837887.028204:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+19:18702:x1875732037024256:12345-0@lo:501:mount.lustre.0 Request processed in 165us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837887.028225:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788837887.030081:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837887.030146:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788837887.030209:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.030235:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 11 seconds 00000100:00100000:3.0:1788837887.030333:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037024384 00000100:00100000:3.0:1788837887.030339:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037024384 00000100:00100000:3.0:1788837887.030395:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788837887.030675:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+19:18702:x1875732037024384:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837887.031970:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+19:18702:x1875732037024384:12345-0@lo:503:mount.lustre.0 Request processed in 1561us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837887.031980:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788837887.032575:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024384:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788837887.033490:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788837887.033606:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788837887.033682:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.033811:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae30b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837887.041301:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037024512 00000100:00100000:0.0:1788837887.041319:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037024512 00000100:00100000:0.0:1788837887.041862:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788837887.041875:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+19:18702:x1875732037024512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837887.042538:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+19:18702:x1875732037024512:12345-0@lo:502:mount.lustre.0 Request processed in 665us (8854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837887.042547:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788837887.042714:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788837887.043002:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788837887.043034:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788837887.043065:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788837887.043080:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788837887.043094:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788837887.043107:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788837887.043120:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788837887.043147:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788837887.043161:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788837887.043175:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788837887.043185:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788837887.043197:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788837887.043234:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788837887.043282:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837887.050198:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c25976c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837887.062876:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037024640 00000100:00100000:1.0:1788837887.062892:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037024640 00000100:00100000:1.0:1788837887.062966:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788837887.062978:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+19:18702:x1875732037024640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788837887.063177:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+19:18702:x1875732037024640:12345-0@lo:502:mount.lustre.0 Request processed in 201us (19895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.063186:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788837887.063309:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788837887.063414:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788837887.063429:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788837887.064162:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788837887.064170:0:18720:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788837887.064176:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837887.064178:0:18720:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788837887.064184:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788837887.064199:0:18720:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff889ae7f38000) 00000020:00000080:1.0:1788837887.064221:0:18720:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788837887.064227:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788837887.064321:0:18720:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ae7d4a800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788837887.064329:0:18720:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788837887.064336:0:18720:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x57f6d4e926af031b 00010000:00010000:1.0:1788837887.067339:0:18720:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788837887.068734:0:18720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788837887.071559:0:18720:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788837887.083698:0:18720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788837887.083711:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837887.083717:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837887.083719:0:18720:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788837887.083723:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788837887.083725:0:18720:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788837887.083727:0:18720:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788837887.083728:0:18720:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788837887.083729:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788837887.083732:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837887.083733:0:18720:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788837887.083735:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837887.083738:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837887.083739:0:18720:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788837887.083742:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788837887.083748:0:18720:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788837887.083751:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837887.083753:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837887.083755:0:18720:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788837887.083757:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837887.083759:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837887.083761:0:18720:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788837887.083764:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788837887.083833:0:18720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837887.083837:0:18720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837887.083838:0:18720:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788837887.083841:0:18720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788837887.084066:0:18702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788837887.084094:0:18702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788837887.084116:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af030d expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837887.084137:0:18702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c9c00/0x57f6d4e926af0306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af030d expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837887.084145:0:18702:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ae7d4a800 from 1 10000000:01000000:0.0:1788837887.084148:0:18702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837887.084184:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837887.084193:0:18702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837887.084204:0:18702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837887.084228:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837887.084307:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837887.084344:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad080ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788837887.087276:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037024768 00000100:00100000:2.0:1788837887.087292:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037024768 00000100:00100000:2.0:1788837887.087355:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788837887.087366:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+19:18702:x1875732037024768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837887.087383:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837887.087402:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac1324600/0x57f6d4e926af0329 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0322 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837887.087545:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac1324600/0x57f6d4e926af0329 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0322 expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837887.087557:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac1324600/0x57f6d4e926af0329 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0322 expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837887.087567:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac1324600, rc 0) 00000100:00100000:2.0:1788837887.087655:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:18702:x1875732037024768:12345-0@lo:101:mount.lustre.0 Request processed in 290us (3348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837887.087662:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788837887.087765:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837887.087813:0:18702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0329 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837887.087822:0:18702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0329 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837887.088929:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788837887.090289:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837887.091613:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788837887.091651:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788837887.091671:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788837887.091675:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788837887.091769:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837887.091852:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837887.091900:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad080e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837887.092521:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037024896 00000100:00100000:2.0:1788837887.092538:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037024896 00000100:00100000:2.0:1788837887.092583:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788837887.092592:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:18702:x1875732037024896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837887.092730:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:18702:x1875732037024896:12345-0@lo:501:mount.lustre.0 Request processed in 139us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837887.092737:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788837887.092910:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037024896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837887.092961:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788837887.093005:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.093035:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 11 seconds 00000100:00100000:0.0:1788837887.093100:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037025024 00000100:00100000:0.0:1788837887.093105:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037025024 00000100:00100000:0.0:1788837887.093233:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788837887.093241:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:18702:x1875732037025024:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788837887.093322:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:18702:x1875732037025024:12345-0@lo:503:mount.lustre.0 Request processed in 82us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837887.093328:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788837887.098900:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025024:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788837887.100563:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788837887.100663:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837887.100762:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837887.101263:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad080ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837887.101308:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037025152 00000100:00100000:1.0:1788837887.101316:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037025152 00000100:00100000:1.0:1788837887.101397:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788837887.101502:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:18702:x1875732037025152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788837887.101632:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:18702:x1875732037025152:12345-0@lo:502:mount.lustre.0 Request processed in 227us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.101641:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788837887.101721:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837887.101970:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788837887.101998:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788837887.102012:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788837887.102025:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788837887.102038:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788837887.102049:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788837887.102060:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788837887.102072:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788837887.102084:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788837887.102096:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788837887.102108:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788837887.102143:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837887.102181:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837887.102545:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6e4d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837887.102616:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037025280 00000100:00100000:0.0:1788837887.102621:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037025280 00000100:00100000:0.0:1788837887.102652:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788837887.102660:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:18702:x1875732037025280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837887.102763:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:18702:x1875732037025280:12345-0@lo:502:mount.lustre.0 Request processed in 103us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837887.102770:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788837887.103014:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837887.103060:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788837887.103068:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788837887.103835:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837887.103846:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837887.103848:0:18724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788837887.103854:0:18724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ae7d4a800 00000020:00000080:2.0:1788837887.103864:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788837887.103872:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837887.103875:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837887.103877:0:18724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788837887.103879:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837887.103881:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837887.103883:0:18724:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788837887.103886:0:18724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889ae7d4a800 00000020:00000080:2.0:1788837887.103888:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788837887.103955:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837887.103959:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837887.103961:0:18724:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788837887.103963:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837887.103965:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837887.103967:0:18724:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788837887.103970:0:18724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ae7d4a800 00000020:00000080:2.0:1788837887.103972:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788837887.103989:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837887.103992:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837887.103993:0:18724:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788837887.103995:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837887.103998:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837887.103999:0:18724:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788837887.104002:0:18724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889ae7d4a800 00000020:00000080:2.0:1788837887.104004:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788837887.104023:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837887.104026:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837887.104027:0:18724:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788837887.104030:0:18724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788837887.111255:0:18702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788837887.111306:0:18702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788837887.111328:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0329 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.111340:0:18702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0329 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837887.111413:0:18702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788837887.111417:0:18702:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff889ae7d4a800 10000000:01000000:1.0:1788837887.111420:0:18702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff889ae7d4a800 10000000:01000000:1.0:1788837887.111424:0:18702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788837887.111432:0:18702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889ae7d4a800 from 1 10000000:01000000:1.0:1788837887.111435:0:18702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788837887.111473:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.111482:0:18702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.111493:0:18702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837887.111528:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788837887.111596:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.111638:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 11 seconds 00000100:00100000:0.0:1788837887.116101:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037025408 00000100:00100000:0.0:1788837887.116116:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037025408 00000100:00100000:0.0:1788837887.116175:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788837887.116185:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:18702:x1875732037025408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837887.116203:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837887.116224:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9a600/0x57f6d4e926af0337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0330 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837887.116252:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9a600/0x57f6d4e926af0337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0330 expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837887.116264:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9a600/0x57f6d4e926af0337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0330 expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837887.116273:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9a600, rc 0) 00000100:00100000:0.0:1788837887.116347:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:18702:x1875732037025408:12345-0@lo:101:mount.lustre.0 Request processed in 162us (4750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837887.116354:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788837887.117070:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788837887.117090:0:18702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0337 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.117100:0:18702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0337 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788837887.124526:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788837887.126306:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837887.127731:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788837887.127806:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788837887.127825:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788837887.127839:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788837887.127852:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788837887.127866:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788837887.127898:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788837887.127926:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788837887.127943:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788837887.127958:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788837887.127971:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788837887.127984:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788837887.127998:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788837887.128011:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788837887.128025:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788837887.128038:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788837887.128051:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788837887.128076:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788837887.128091:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788837887.128107:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788837887.134550:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788837887.134593:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788837887.134625:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788837887.134642:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788837887.134657:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788837887.134671:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788837887.134687:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788837887.134700:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788837887.134715:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788837887.134730:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788837887.134745:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788837887.134758:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788837887.134771:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788837887.134803:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788837887.134817:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788837887.134830:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788837887.134842:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788837887.134867:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788837887.134873:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788837887.138619:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837887.138696:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.138748:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c36f0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788837887.139248:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037025536 00000100:00100000:0.0:1788837887.139284:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037025536 00000100:00100000:0.0:1788837887.139334:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788837887.139342:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:18702:x1875732037025536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837887.139526:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:18702:x1875732037025536:12345-0@lo:501:mount.lustre.0 Request processed in 184us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837887.139534:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788837887.140329:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837887.140379:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837887.140447:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837887.140493:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6e4da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837887.142264:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037025664 00000100:00100000:1.0:1788837887.142280:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037025664 00000100:00100000:1.0:1788837887.142342:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788837887.142353:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:18702:x1875732037025664:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788837887.142529:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:18702:x1875732037025664:12345-0@lo:503:mount.lustre.0 Request processed in 178us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.142547:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788837887.142726:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025664:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788837887.143210:0:18702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788837887.143289:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025792:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837887.143341:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837887.143376:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae30b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837887.143589:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037025792 00000100:00100000:1.0:1788837887.143595:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037025792 00000100:00100000:1.0:1788837887.143622:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788837887.143628:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:18702:x1875732037025792:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788837887.143713:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:18702:x1875732037025792:12345-0@lo:502:mount.lustre.0 Request processed in 84us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.143720:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788837887.144215:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837887.144499:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788837887.144525:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788837887.144536:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788837887.144547:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788837887.144557:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788837887.144568:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788837887.144578:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788837887.144589:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788837887.144599:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788837887.144621:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788837887.144633:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788837887.144644:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788837887.144654:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788837887.144665:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788837887.144675:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788837887.144686:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788837887.144696:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788837887.144706:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788837887.144717:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788837887.144727:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788837887.144737:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788837887.144747:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788837887.144757:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788837887.144811:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788837887.144830:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788837887.144856:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788837887.144872:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788837887.144884:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788837887.144897:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788837887.144922:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788837887.144938:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788837887.144950:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788837887.144961:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788837887.144972:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788837887.144983:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788837887.144994:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788837887.145005:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788837887.145017:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788837887.145030:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788837887.145041:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788837887.145053:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788837887.145079:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788837887.145095:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788837887.145109:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788837887.146595:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788837887.146625:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788837887.146641:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788837887.146655:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788837887.146705:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837887.146801:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837887.146847:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 11 seconds 00000100:00100000:3.0:1788837887.147233:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037025920 00000100:00100000:3.0:1788837887.147242:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037025920 00000100:00100000:3.0:1788837887.147292:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788837887.147301:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:18702:x1875732037025920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788837887.147529:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:18702:x1875732037025920:12345-0@lo:502:mount.lustre.0 Request processed in 228us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837887.147543:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788837887.148611:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037025920:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837887.148899:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788837887.148937:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788837887.148979:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037026048:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837887.149033:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837887.149070:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889acae30b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788837887.150549:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037026048 00000100:00100000:0.0:1788837887.150560:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037026048 00000100:00100000:0.0:1788837887.150619:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788837887.150629:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:18702:x1875732037026048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837887.150803:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:18702:x1875732037026048:12345-0@lo:502:mount.lustre.0 Request processed in 174us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837887.150811:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788837887.156301:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037026048:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837887.156394:0:18702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788837887.157554:0:18702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788837887.167682:0:18729:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788837887.167699:0:18729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff889ac84899b8) 00000020:00000080:3.0:1788837887.167722:0:18729:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788837887.167851:0:18729:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ae7d4a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788837887.167856:0:18729:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ae7d4a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788837887.167858:0:18729:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ae7d4a800 3 00010000:00080000:3.0:1788837887.167897:0:18729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8899c4400000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788837887.171050:0:18729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788837887.171513:0:18729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788837887.171560:0:18729:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788837887.171572:0:18729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x57f6d4e926af0345 00000100:00080000:3.0:1788837887.171583:0:18729:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788837887.171589:0:18729:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8899c4400000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837887.171627:0:18729:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ad17aca80 x1875732037026176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788837887.171698:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875732037026176:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788837887.171799:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788837887.171880:0:18729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788837887.172093:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837887.172098:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837887.172101:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837887.172104:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837887.172137:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837887.172140:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837887.172143:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837887.172145:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788837887.172257:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732037026432:0@lo:400:kworker.0 00000100:00100000:1.0:1788837887.172290:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.172313:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837887.172319:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037026304:0@lo:400:kworker.0 00000100:00100000:1.0:1788837887.172345:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.172373:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037026560:0@lo:400:kworker.0 00000100:00100000:1.0:1788837887.172432:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.172452:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837887.172457:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037026688:0@lo:400:kworker.0 00000100:00100000:1.0:1788837887.172476:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.172503:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037026176 00000100:00100000:1.0:1788837887.172510:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037026176 00000100:00100000:1.0:1788837887.172534:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037026432 00000100:00100000:1.0:1788837887.172536:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037026432 00000100:00100000:1.0:1788837887.172560:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037026688 00000100:00100000:1.0:1788837887.172563:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037026688 00000100:00100000:1.0:1788837887.172580:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788837887.172589:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732037026432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837887.172652:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732037026432:12345-0@lo:400:kworker.0 Request processed in 63us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.172660:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788837887.172675:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837887.172682:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037026688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837887.172713:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037026688:12345-0@lo:400:kworker.0 Request processed in 31us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.172719:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837887.172730:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837887.172734:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875732037026176:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788837887.172754:0:17202:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:1.0:1788837887.172818:0:17202:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x57f6d4e926af034c 00000004:00100000:1.0:1788837887.172834:0:17202:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788837887.172865:0:17202:0:(import.c:65:import_set_state_nolock()) ffff8899c277f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837887.175330:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875732037026176:12345-0@lo:38:llog_process_th.0 Request processed in 2582us (3545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.175351:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788837887.175396:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037026304 00000100:00100000:1.0:1788837887.175415:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037026304 00000100:00100000:1.0:1788837887.175452:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037026560 00000100:00100000:1.0:1788837887.175455:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037026560 00000100:00100000:1.0:1788837887.175469:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788837887.175476:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037026304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837887.175539:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037026304:12345-0@lo:400:kworker.0 Request processed in 63us (3193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.175546:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788837887.175559:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837887.175565:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037026560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837887.175607:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037026560:12345-0@lo:400:kworker.0 Request processed in 42us (3174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.175614:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837887.175662:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037026304:0@lo:400:kworker.0 00010000:00080000:1.0:1788837887.175678:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889afa5f1500 x1875732037026432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837887.175690:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732037026432:0@lo:400:kworker.0 00010000:00080000:1.0:1788837887.175725:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889afa5f3480 x1875732037026688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837887.175734:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037026688:0@lo:400:kworker.0 00000100:00100000:1.0:1788837887.175744:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037026560:0@lo:400:kworker.0 00000020:01000004:3.0:1788837887.177000:0:18729:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788837887.177029:0:18729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8899c3d33370) 00000020:00000080:3.0:1788837887.177054:0:18729:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788837887.177154:0:18729:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889ae7d4a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788837887.177159:0:18729:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889ae7d4a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788837887.177161:0:18729:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889ae7d4a800 3 00010000:00080000:3.0:1788837887.177189:0:18729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8899c4403000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.103@tcp at head 00010000:00080000:2.0:1788837887.183106:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889ad17aca80 x1875732037026176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788837887.183372:0:18729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000100:00100000:2.0:1788837887.183479:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788837887.183490:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788837887.183499:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788837887.183505:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788837887.183508:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c4400000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788837887.183515:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875732037026176:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1788837887.184973:0:18729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788837887.185022:0:18729:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788837887.185032:0:18729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x57f6d4e926af035a 00000100:00080000:3.0:1788837887.185047:0:18729:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788837887.185052:0:18729:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8899c4403000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837887.185081:0:18729:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ad17ac000 x1875732037026816/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837887.185104:0:18729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788837887.185347:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875732037026816:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788837887.185427:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788837887.185564:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837887.185575:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837887.185578:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837887.185581:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837887.185584:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837887.185587:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837887.185589:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837887.185592:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788837887.185609:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037026816 00000100:00100000:1.0:1788837887.185614:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037026816 00000100:00100000:1.0:1788837887.185650:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788837887.185657:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875732037026816:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788837887.185679:0:17202:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:1.0:1788837887.185705:0:17202:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x57f6d4e926af0361 00000004:00100000:1.0:1788837887.185718:0:17202:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788837887.185744:0:17202:0:(import.c:65:import_set_state_nolock()) ffff8899c277b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837887.185811:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875732037026816:12345-0@lo:38:llog_process_th.0 Request processed in 154us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.185827:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788837887.185861:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889ad17ac000 x1875732037026816/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837887.185871:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788837887.185877:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788837887.185882:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788837887.185885:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788837887.185892:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c4403000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788837887.185897:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875732037026816:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788837887.187026:0:18729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788837887.190281:0:18702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788837887.190331:0:18702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788837887.190406:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0337 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837887.190418:0:18702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c8800/0x57f6d4e926af0330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0337 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788837887.190467:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788837887.190469:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788837887.190475:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837887.190476:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837887.190478:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837887.190479:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837887.190480:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837887.190482:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837887.190483:0:18702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788837887.190487:0:18702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788837887.190489:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788837887.190490:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788837887.190491:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837887.190492:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837887.190493:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837887.190493:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837887.190494:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837887.190495:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837887.190496:0:18702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788837887.190522:0:18702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788837887.190543:0:18702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037026944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788837887.190613:0:18702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837887.190663:0:18702:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af9971180 going to sleep for 11 seconds 00000100:00100000:1.0:1788837887.192589:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037026944 00000100:00100000:1.0:1788837887.192602:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037026944 00000100:00100000:1.0:1788837887.192664:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788837887.192674:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:18702:x1875732037026944:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788837887.192703:0:17195:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788837887.192716:0:17195:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788837887.198586:0:17195:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788837887.198635:0:17195:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788837887.201451:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:18702:x1875732037026944:12345-0@lo:253:mount.lustre.0 Request processed in 8769us (10828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837887.201466:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788837887.201539:0:18702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:18702:1875732037026944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788837887.201554:0:18702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788837887.201557:0:18702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788837887.201559:0:18702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788837887.201560:0:18702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837887.201562:0:18702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837887.201563:0:18702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837887.201565:0:18702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837887.201566:0:18702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788837887.201568:0:18702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837887.201577:0:18702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788837887.201593:0:18702:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788837887.204558:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788837887.204567:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788837887.204592:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.204611:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926af02b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af02ab expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.204619:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af02c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af02b9 expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.204627:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.204671:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af02c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af02b9 expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.204685:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af02c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af02b9 expref: 20 pid: 17192 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837887.204698:0:17216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875732037027072:0@lo:104: 00000100:00100000:1.0:1788837887.204762:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837887.204858:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926af02b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af02ab expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.204867:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926af02b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af02ab expref: 20 pid: 17194 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837887.204874:0:17216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875732037027200:0@lo:104: 00000100:00100000:1.0:1788837887.204901:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.204928:0:17216:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b01a52900 going to sleep for 11 seconds 00000100:00100000:1.0:1788837887.204956:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788837887.204971:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037027072 00000100:00100000:1.0:1788837887.204977:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037027072 00000100:00100000:1.0:1788837887.205009:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037027200 00000100:00100000:1.0:1788837887.205012:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037027200 00000100:00100000:1.0:1788837887.205027:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837887.205034:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+4:17216:x1875732037027072:12345-0@lo:104: 00010000:00010000:1.0:1788837887.205046:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af02c0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.205093:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788837887.205099:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+4:17216:x1875732037027072:12345-0@lo:104: Request processed in 66us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.205106:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837887.205135:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837887.205142:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ae7cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:17216:x1875732037027200:12345-0@lo:104: 00010000:00010000:1.0:1788837887.205150:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af02b2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.205182:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788837887.205193:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ae7cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:17216:x1875732037027200:12345-0@lo:104: Request processed in 52us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.205199:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788837887.205244:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837887.205250:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af02c0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.205258:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324e00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837887.205261:0:17953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af02c0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.205270:0:17953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af02c0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837887.205277:0:17953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af02c0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837887.205283:0:17953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837887.205310:0:17953:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af02c0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.205317:0:17953:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837887.205335:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af02c0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.205341:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac1324e00/0x57f6d4e926af02b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af02c0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.205353:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837887.205356:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af02b2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.205372:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac6000 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:1.0:1788837887.205375:0:17953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af02b2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.205381:0:17953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af02b2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837887.205387:0:17953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af02b2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837887.205392:0:17953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837887.207213:0:17953:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af02b2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.207229:0:17953:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837887.207246:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af02b2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.207253:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ad8ac6000/0x57f6d4e926af02ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af02b2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.207277:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837887.207278:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837887.207280:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837887.207293:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837887.207310:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037027328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837887.207367:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.207547:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837887.207555:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037027456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837887.207597:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837887.207635:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037027328 00000100:00100000:1.0:1788837887.207641:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037027328 00010000:00010000:1.0:1788837887.207686:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af02c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af02b9 expref: 21 pid: 17192 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837887.207713:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037027456 00000100:00100000:1.0:1788837887.207717:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037027456 00010000:00010000:1.0:1788837887.207728:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926af02b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af02ab expref: 22 pid: 17194 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837887.207742:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837887.207750:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:3650:x1875732037027328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837887.207761:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837887.207765:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af02c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af02b9 expref: 22 pid: 17192 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.207794:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af02c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af02b9 expref: 22 pid: 17192 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.207814:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837887.207926:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:3650:x1875732037027328:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.207934:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837887.207951:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837887.207958:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc2ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:3650:x1875732037027456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837887.207966:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837887.207970:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926af02b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af02ab expref: 21 pid: 17194 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.207989:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926af02b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af02ab expref: 21 pid: 17194 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.208001:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.208010:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788837887.208024:0:17185:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016148958s 00010000:00010000:1.0:1788837887.208028:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.208035:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.208041:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.208048:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.208055:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837887.208059:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.208067:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.208076:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.208092:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837887.208115:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc2ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:3650:x1875732037027456:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837887.208121:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788837887.208193:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037027456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837887.208201:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037027328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837887.208230:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9b200/0x57f6d4e926af02c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af02b9 expref: 20 pid: 17192 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837887.208241:0:17216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875732037027072:0@lo:104: 00010000:00010000:1.0:1788837887.208250:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926af02b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af02ab expref: 19 pid: 17194 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837887.208257:0:17216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875732037027200:0@lo:104: 00010000:00010000:1.0:1788837887.208271:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.208279:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.208285:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837887.208291:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c8c00/0x57f6d4e926af0368 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788837887.216588:0:18702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788837887.227268:0:18702:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788837887.227277:0:18702:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788837887.227320:0:18702:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788837887.227360:0:18702:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788837887.227386:0:18702:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788837887.227514:0:18702:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788837887.228424:0:18702:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788837887.228653:0:18702:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788837887.294145:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837888.313175:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788837888.428283:0:18782:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788837888.429483:0:18782:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788837888.442488:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788837888.442496:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ac444e800 from 9 10000000:01000000:3.0:1788837888.442501:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788837888.442547:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837888.442558:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837888.442570:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837888.442592:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037027584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837888.442660:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837888.442704:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6c0b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788837888.443203:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037027584 00000100:00100000:0.0:1788837888.443211:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037027584 00000100:00100000:0.0:1788837888.444434:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788837888.444448:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+19:17197:x1875732037027584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837888.444464:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837888.444483:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9a000/0x57f6d4e926af0376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af036f expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837888.444508:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9a000/0x57f6d4e926af0376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af036f expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837888.444530:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9a000/0x57f6d4e926af0376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af036f expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837888.444539:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9a000, rc 0) 00000100:00100000:0.0:1788837888.444604:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:17197:x1875732037027584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837888.444611:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788837888.448393:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037027584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837888.448426:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0376 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837888.448440:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0376 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837888.448527:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037027712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788837888.448597:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837888.458539:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac3eb0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837888.464486:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037027712 00000100:00100000:0.0:1788837888.464503:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037027712 00000100:00100000:0.0:1788837888.464560:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788837888.464571:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:17197:x1875732037027712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788837888.464602:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788837888.464619:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788837888.464622:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788837888.466045:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:17197:x1875732037027712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 207us (16179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837888.466058:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788837888.473238:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037027712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788837888.473337:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788837888.473348:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0376 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837888.473360:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0376 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837888.473371:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788837888.473384:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ac409c800 from 9 10000000:01000000:2.0:1788837888.473387:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788837888.473421:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837888.473430:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837888.473441:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837888.473461:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037027840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837888.473521:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837888.473567:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac3eb0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837888.473666:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037027840 00000100:00100000:0.0:1788837888.473674:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037027840 00000100:00100000:0.0:1788837888.473726:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788837888.473737:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:17197:x1875732037027840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837888.473749:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837888.473763:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0384 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af037d expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837888.474041:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af037d expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837888.474064:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af037d expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837888.474083:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b800, rc 0) 00000100:00100000:0.0:1788837888.476385:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:17197:x1875732037027840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2642us (2855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837888.476398:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788837888.480302:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037027840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837888.480335:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0384 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837888.480348:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0384 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837888.480442:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037027968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788837888.480512:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837888.480550:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6c0b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788837888.480750:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037027968 00000100:00100000:2.0:1788837888.480758:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037027968 00000100:00100000:2.0:1788837888.480842:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788837888.480852:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:17197:x1875732037027968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788837888.480873:0:17195:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788837888.480899:0:17195:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788837888.480903:0:17195:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788837888.481001:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:17197:x1875732037027968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 150us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837888.481009:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788837888.481223:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037027968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788837888.481279:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788837888.481287:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0384 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837888.481295:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0384 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837889.347011:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837889.977242:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837889.977267:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037028096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837889.977344:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837889.977831:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037028096 00000100:00100000:1.0:1788837889.977840:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037028096 00000100:00100000:1.0:1788837889.977894:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837889.977904:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037028096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788837889.977955:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788837889.977989:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037028224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837889.977999:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037028096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837889.978007:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788837889.978015:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837889.978058:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037028096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837889.985220:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037028224 00000100:00100000:1.0:1788837889.985237:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037028224 00000100:00100000:1.0:1788837889.985293:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788837889.985303:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037028224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788837889.985341:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788837889.985425:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037028224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (7408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837889.985433:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788837889.985496:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037028224:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788837890.361401:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837891.384947:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788837891.961815:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788837892.417850:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788837892.537036:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837892.537043:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837892.537046:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837892.537050:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837892.537076:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837892.537079:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788837892.537088:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837892.537091:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788837892.537135:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037028352:0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.537211:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837892.537260:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037028864:0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.537286:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837892.537312:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788837892.537318:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037028480:0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.537344:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837892.537362:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732037028992:0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.537387:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837892.537433:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037028608:0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.537458:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837892.537476:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732037029120:0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.537498:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837892.537511:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837892.537516:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afa5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037028736:0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.537551:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837892.537586:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037028352 00000100:00100000:1.0:1788837892.537594:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037028352 00000100:00100000:1.0:1788837892.537640:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788837892.537649:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:3650:x1875732037028352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.537714:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:3650:x1875732037028352:12345-0@lo:400:kworker.0 Request processed in 66us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837892.537733:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788837892.537770:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037028864 00000100:00100000:1.0:1788837892.537774:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037028864 00000100:00100000:1.0:1788837892.537829:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037028992 00000100:00100000:1.0:1788837892.537833:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037028992 00000100:00100000:1.0:1788837892.537860:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037028608 00000100:00100000:1.0:1788837892.537863:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037028608 00000100:00100000:1.0:1788837892.537874:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037029120 00000100:00100000:1.0:1788837892.537877:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037029120 00000100:00100000:1.0:1788837892.537892:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788837892.537898:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037028864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.537932:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037028864:12345-0@lo:400:kworker.0 Request processed in 34us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837892.537939:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788837892.537953:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788837892.537960:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732037028992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.537987:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732037028992:12345-0@lo:400:kworker.0 Request processed in 28us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837892.537994:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788837892.538006:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837892.538012:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037028608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.538043:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037028608:12345-0@lo:400:kworker.0 Request processed in 31us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837892.538049:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837892.538061:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788837892.538067:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732037029120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.538104:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732037029120:12345-0@lo:400:kworker.0 Request processed in 37us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837892.538110:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788837892.538128:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037028480 00000100:00100000:1.0:1788837892.538131:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037028480 00000100:00100000:1.0:1788837892.538155:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037028736 00000100:00100000:1.0:1788837892.538158:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037028736 00000100:00100000:1.0:1788837892.538171:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788837892.538177:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037028480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.538207:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037028480:12345-0@lo:400:kworker.0 Request processed in 31us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837892.538213:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788837892.538225:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788837892.538231:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037028736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.538257:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037028736:12345-0@lo:400:kworker.0 Request processed in 27us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837892.538262:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788837892.538312:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037028736:0@lo:400:kworker.0 00010000:00080000:1.0:1788837892.538326:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c27bdf80 x1875732037028608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837892.538337:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037028608:0@lo:400:kworker.0 00010000:00080000:1.0:1788837892.538347:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ac85e8e00 x1875732037029120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837892.538355:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732037029120:0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.538386:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037028480:0@lo:400:kworker.0 00010000:00080000:1.0:1788837892.538406:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa5f3480 x1875732037028992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837892.538415:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732037028992:0@lo:400:kworker.0 00000100:00100000:1.0:1788837892.538424:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037028352:0@lo:400:kworker.0 00010000:00080000:1.0:1788837892.538432:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889afa5f2a00 x1875732037028864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837892.538441:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afa5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037028864:0@lo:400:kworker.0 00000100:00080000:0.0:1788837892.540927:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788837892.540939:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788837893.445190:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837894.328874:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837879/real 1788837879] req@ffff8899c3dd5f80 x1875732037021824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837894 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837894.328907:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8899c3dd5f80 x1875732037021824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837894 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837894.328918:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837879/real 1788837879] req@ffff8899c3dd4a80 x1875732037021952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837894 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837894.328929:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8899c3dd4a80 x1875732037021952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837894 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788837894.328950:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ad9a71000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837894.328982:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788837894.328987:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037021824:0@lo:8:kworker.0 00000100:00080000:1.0:1788837894.329000:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837894.329005:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788837894.329008:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037021952:0@lo:8:kworker.0 00000100:00080000:3.0:1788837894.329260:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788837894.329265:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788837894.329268:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788837894.329271:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788837894.329284:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788837894.329286:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788837894.329289:0:37:0:(import.c:65:import_set_state_nolock()) ffff889ad9a71000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837894.329293:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 496 00000100:00080000:3.0:1788837894.329299:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788837894.329305:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff889ad9a71000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837894.329333:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ad17aca80 x1875732037029760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837894.329345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788837894.329348:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788837894.329350:0:37:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837894.329353:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 496 00000100:00080000:3.0:1788837894.329355:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788837894.329358:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff889af8dbc000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837894.329368:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ad17af100 x1875732037029888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837894.329403:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037029632:0@lo:400:kworker.0 00000100:00100000:3.0:1788837894.329461:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837894.329489:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788837894.329495:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037029248:0@lo:400:kworker.0 00000100:00100000:3.0:1788837894.329516:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837894.329536:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037030016:0@lo:400:kworker.0 00000100:00100000:3.0:1788837894.329554:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837894.329575:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037029376:0@lo:400:kworker.0 00000100:00100000:3.0:1788837894.329594:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837894.329611:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732037030144:0@lo:400:kworker.0 00000100:00100000:3.0:1788837894.329635:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837894.329651:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788837894.329656:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037029504:0@lo:400:kworker.0 00000100:00100000:3.0:1788837894.329675:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837894.329698:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037030272:0@lo:400:kworker.0 00000100:00100000:3.0:1788837894.329722:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837894.329748:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037029632 00000100:00100000:3.0:1788837894.329756:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037029632 00000100:00100000:3.0:1788837894.329835:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037029376 00000100:00100000:3.0:1788837894.329839:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037029376 00000100:00100000:3.0:1788837894.329856:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837894.329864:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037029632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837894.329913:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037029632:12345-0@lo:400:kworker.0 Request processed in 50us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837894.329920:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788837894.329936:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788837894.329941:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037029376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837894.329987:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037029376:12345-0@lo:400:kworker.0 Request processed in 44us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837894.330144:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037030016 00000100:00100000:1.0:1788837894.330155:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037030016 00000100:00100000:1.0:1788837894.330179:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037030144 00000100:00100000:1.0:1788837894.330181:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037030144 00000100:00100000:1.0:1788837894.330204:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037029504 00000100:00100000:1.0:1788837894.330207:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037029504 00000100:00100000:1.0:1788837894.330215:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037030272 00000100:00100000:1.0:1788837894.330218:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037030272 00000100:00100000:1.0:1788837894.330229:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788837894.330235:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037030016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837894.330271:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037030016:12345-0@lo:400:kworker.0 Request processed in 36us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837894.330276:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788837894.330288:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837894.330294:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732037030144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837894.330319:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732037030144:12345-0@lo:400:kworker.0 Request processed in 25us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837894.330324:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788837894.330335:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837894.330341:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037029504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837894.330367:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037029504:12345-0@lo:400:kworker.0 Request processed in 26us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837894.330374:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788837894.330385:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788837894.330390:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037030272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837894.330418:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037030272:12345-0@lo:400:kworker.0 Request processed in 28us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837894.330423:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788837894.330451:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837894.330455:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837894.330506:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788837894.330530:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037029248 00000100:00100000:3.0:1788837894.330534:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037029248 00000100:00100000:3.0:1788837894.330569:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788837894.330577:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:3648:x1875732037029248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837894.330609:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:3648:x1875732037029248:12345-0@lo:400:kworker.0 Request processed in 34us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837894.330615:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1788837894.330672:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ad17ae680 x1875732037029504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837894.330686:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037029504:0@lo:400:kworker.0 00010000:00080000:3.0:1788837894.330707:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ad17adc00 x1875732037030272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837894.330716:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037030272:0@lo:400:kworker.0 00000100:00100000:3.0:1788837894.330725:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037029376:0@lo:400:kworker.0 00010000:00080000:3.0:1788837894.330733:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ad17ad180 x1875732037030144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837894.330741:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732037030144:0@lo:400:kworker.0 00000100:00100000:3.0:1788837894.330771:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037029248:0@lo:400:kworker.0 00010000:00080000:3.0:1788837894.330814:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ad17ac380 x1875732037030016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837894.330822:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037030016:0@lo:400:kworker.0 00000100:00100000:3.0:1788837894.330832:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037029632:0@lo:400:kworker.0 00000100:00100000:3.0:1788837894.330854:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037029760:0@lo:8:kworker.0 00000100:00100000:3.0:1788837894.330886:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837894.330914:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037029888:0@lo:8:kworker.0 00000100:00100000:3.0:1788837894.330936:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837894.331104:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037029760 00000100:00100000:3.0:1788837894.331108:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037029760 00000100:00100000:3.0:1788837894.331125:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037029888 00000100:00100000:3.0:1788837894.331128:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037029888 00000100:00100000:3.0:1788837894.331139:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837894.331144:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037029760:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788837894.331169:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:3.0:1788837894.331204:0:18707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926af038b 00002000:00100000:3.0:1788837894.331218:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8899c4403800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788837894.331222:0:18707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788837894.331225:0:18707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788837894.331403:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788837894.331426:0:18707:0:(import.c:65:import_set_state_nolock()) ffff8899c4404800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837894.331473:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875732037029760:12345-0@lo:8:kworker.0 Request processed in 328us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837894.331480:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837894.331493:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837894.331497:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037029888:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788837894.331509:0:18707:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788837894.340242:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ad17aca80 x1875732037029760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788837914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837894.340258:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788837894.340268:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788837894.340278:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788837894.340298:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788837894.340302:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ad9a71000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788837894.341088:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788837894.341099:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037029760:0@lo:8:kworker.0 00000004:00080000:2.0:1788837894.341954:0:17941:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788837894.342121:0:17941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 511213344179ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788837894.342131:0:17941:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788837894.348159:0:17942:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788837894.348191:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1875732037030528:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788837894.348274:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837894.348304:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad080eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837894.348337:0:18708:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788837894.348344:0:18708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788837894.348442:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837894.348456:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037030400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837894.348485:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837894.348520:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037030400 00000100:00100000:1.0:1788837894.348528:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037030400 00000100:00100000:1.0:1788837894.348580:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788837894.348588:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875732037030400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788837894.348614:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788837894.348657:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875732037030400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837894.348665:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788837894.348702:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837894.348728:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ac85e8e00 x1875732037030400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837894.348746:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037030400:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1788837894.350134:0:17933:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788837894.352734:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037030528 00000100:00100000:1.0:1788837894.352747:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037030528 00000100:00100000:2.0:1788837894.353173:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837894.353185:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17942:x1875732037030528:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788837894.355840:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037029888:12345-0@lo:8:kworker.0 Request processed in 24332us (24894us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837894.355853:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788837894.360102:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788837894.360115:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788837894.360120:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037029888:0@lo:8:kworker.0 00002000:00080000:0.0:1788837894.362526:0:19019:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788837894.362538:0:19019:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788837894.362647:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17942:x1875732037030528:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9460us (14368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837894.362661:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788837894.362825:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ac85eb480 x1875732037030528/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788837910 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837894.362842:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1875732037030528:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788837894.362855:0:17942:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788837894.362896:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4493b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1875732037030656:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788837894.362935:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837894.362964:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac96999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837894.364167:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037030656 00000100:00100000:0.0:1788837894.364177:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037030656 00000100:00100000:0.0:1788837894.364246:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837894.364255:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17942:x1875732037030656:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788837894.364283:0:18708:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788837894.364342:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17942:x1875732037030656:12345-0@lo:5:osp-pre-0-1.0 Request processed in 89us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837894.364349:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788837894.365463:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c4493b80 x1875732037030656/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837910 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837894.365479:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4493b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1875732037030656:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788837894.365499:0:17942:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788837894.365538:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4493b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1875732037030784:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788837894.365573:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837894.365593:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac96999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837894.365868:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037030784 00000100:00100000:0.0:1788837894.365875:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037030784 00000100:00100000:0.0:1788837894.365920:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788837894.365928:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17942:x1875732037030784:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788837894.365960:0:18707:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1788837894.397709:0:18703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788837894.397726:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788837894.398400:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17942:x1875732037030784:12345-0@lo:5:osp-pre-0-1.0 Request processed in 32469us (32823us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788837894.398412:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788837894.398590:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c4493b80 x1875732037030784/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837910 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837894.398603:0:17942:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788837894.398609:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4493b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1875732037030784:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788837894.398623:0:17942:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788837894.398673:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4493b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17942:1875732037030912:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788837894.398708:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837894.398743:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac96999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837894.398833:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037030912 00000100:00100000:0.0:1788837894.398840:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037030912 00000100:00100000:0.0:1788837894.398883:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788837894.398892:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17942:x1875732037030912:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788837894.399523:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17942:x1875732037030912:12345-0@lo:900:osp-pre-0-1.0 Request processed in 629us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837894.399532:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788837894.399600:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c4493b80 x1875732037030912/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788837910 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837894.399611:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4493b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17942:1875732037030912:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1788837894.458342:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837895.099439:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837895.099459:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037031040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837895.099520:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837895.099561:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037031040 00000100:00100000:0.0:1788837895.099567:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037031040 00000100:00100000:0.0:1788837895.099609:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788837895.099616:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037031040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837895.099648:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788837895.099686:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037031040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837895.099699:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788837895.099743:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037031040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837895.103087:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837895.103109:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037031168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837895.103179:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837895.103258:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037031168 00000100:00100000:3.0:1788837895.103266:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037031168 00000100:00100000:3.0:1788837895.103329:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788837895.103338:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037031168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837895.103369:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788837895.103417:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037031168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837895.103435:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788837895.103560:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037031168:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1788837895.336732:0:19073:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788837895.480947:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788837895.931844:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1788837896.181565:0:19125:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788837896.181801:0:19125:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788837896.510068:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788837897.265658:0:19175:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788837897.266159:0:19175:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788837897.529025:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837898.424890:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837878/real 1788837878] req@ffff8899c27be300 x1875732037020544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837898 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837898.424926:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8899c27be300 x1875732037020544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837898 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837898.424936:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837878/real 1788837878] req@ffff8899c27bc380 x1875732037020672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837898 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837898.424949:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8899c27bc380 x1875732037020672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788837898 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788837898.424968:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ad114d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837898.424996:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788837898.425001:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037020544:0@lo:8:kworker.0 00000100:00080000:1.0:1788837898.425006:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837898.425011:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788837898.425014:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037020672:0@lo:8:kworker.0 00000100:00080000:2.0:1788837898.425242:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837898.425248:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788837898.425250:0:37:0:(import.c:65:import_set_state_nolock()) ffff889ad114d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837898.425256:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:2.0:1788837898.425260:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788837898.425266:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff889ad114d000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837898.425287:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c3dd4700 x1875732037031552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837898.425299:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837898.425316:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788837898.425317:0:37:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837898.425321:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:2.0:1788837898.425323:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788837898.425327:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8899c21e7000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837898.425339:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c3dd4000 x1875732037031680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837898.425365:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788837898.425368:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788837898.425370:0:37:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837898.425373:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 511 00000100:00080000:2.0:1788837898.425376:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788837898.425379:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff889af8dbc000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788837898.425389:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c3dd5880 x1875732037032192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788837898.425433:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037031808:0@lo:400:kworker.0 00000100:00100000:2.0:1788837898.425496:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837898.425553:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037032448:0@lo:400:kworker.0 00000100:00100000:2.0:1788837898.425576:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837898.425597:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788837898.425602:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037031424:0@lo:400:kworker.0 00000100:00100000:2.0:1788837898.425626:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837898.425650:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732037032320:0@lo:400:kworker.0 00000100:00100000:2.0:1788837898.425672:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837898.425712:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037031808 00000100:00100000:2.0:1788837898.425751:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037031808 00000100:00100000:3.0:1788837898.425964:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037031936:0@lo:400:kworker.0 00000100:00100000:3.0:1788837898.425996:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837898.426017:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037032576:0@lo:400:kworker.0 00000100:00100000:3.0:1788837898.426038:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837898.426051:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788837898.426057:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037031296:0@lo:400:kworker.0 00000100:00100000:3.0:1788837898.426083:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837898.426102:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037032064:0@lo:400:kworker.0 00000100:00100000:3.0:1788837898.426124:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837898.426150:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037031424 00000100:00100000:3.0:1788837898.426154:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037031424 00000100:00100000:3.0:1788837898.426184:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037031936 00000100:00100000:3.0:1788837898.426199:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037031936 00000100:00100000:3.0:1788837898.426216:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788837898.426224:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037031424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837898.426278:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037031424:12345-0@lo:400:kworker.0 Request processed in 54us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837898.426285:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788837898.426301:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788837898.426307:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037031936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837898.426339:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037031936:12345-0@lo:400:kworker.0 Request processed in 32us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837898.426346:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788837898.426373:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037032064 00000100:00100000:3.0:1788837898.426376:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037032064 00000100:00100000:3.0:1788837898.426407:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788837898.426413:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037032064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837898.426445:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037032064:12345-0@lo:400:kworker.0 Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837898.426451:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788837898.426488:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c3dd5f80 x1875732037032064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788837914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837898.426499:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037032064:0@lo:400:kworker.0 00000100:00100000:3.0:1788837898.426507:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037031936:0@lo:400:kworker.0 00000100:00100000:3.0:1788837898.426531:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037031424:0@lo:400:kworker.0 00000100:00100000:2.0:1788837898.426636:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037032448 00000100:00100000:2.0:1788837898.426640:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037032448 00000100:00100000:2.0:1788837898.426657:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037032320 00000100:00100000:2.0:1788837898.426660:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037032320 00000100:00100000:2.0:1788837898.426670:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037032576 00000100:00100000:2.0:1788837898.426672:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037032576 00000100:00100000:2.0:1788837898.426686:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788837898.426693:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037031808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837898.426746:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037031808:12345-0@lo:400:kworker.0 Request processed in 54us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837898.426752:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788837898.426765:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788837898.426771:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732037032448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837898.426915:0:17200:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788837898.426923:0:17200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:3.0:1788837898.426949:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c3dd6a00 x1875732037031808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837898.426959:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037031808:0@lo:400:kworker.0 00000100:00100000:3.0:1788837898.426984:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788837898.426992:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837898.426998:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732037032320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837898.427036:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732037032320:12345-0@lo:400:kworker.0 Request processed in 38us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837898.427043:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837898.427055:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788837898.427060:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788837898.427075:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037032576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837898.427110:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037032576:12345-0@lo:400:kworker.0 Request processed in 37us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837898.427117:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788837898.427144:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c446c000 x1875732037032576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837898.427153:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037032576:0@lo:400:kworker.0 00010000:00080000:3.0:1788837898.427177:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c3dd5500 x1875732037032320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837898.427185:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732037032320:0@lo:400:kworker.0 00000100:00100000:1.0:1788837898.427291:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037031296 00000100:00100000:1.0:1788837898.427296:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037031296 00000100:00100000:1.0:1788837898.427328:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788837898.427335:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:3650:x1875732037031296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837898.427373:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:3650:x1875732037031296:12345-0@lo:400:kworker.0 Request processed in 40us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837898.427380:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1788837898.427407:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837898.427411:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837898.427414:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837898.427511:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037031552:0@lo:8:kworker.0 00000100:00100000:1.0:1788837898.427548:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837898.427575:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037031680:0@lo:8:kworker.0 00000100:00100000:1.0:1788837898.427596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837898.427612:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037032192:0@lo:8:kworker.0 00000100:00100000:1.0:1788837898.427637:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837898.427670:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037031296:0@lo:400:kworker.0 00000100:00100000:1.0:1788837898.427737:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037031552 00000100:00100000:1.0:1788837898.427741:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037031552 00000100:00100000:1.0:1788837898.427757:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037031680 00000100:00100000:1.0:1788837898.427760:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037031680 00000100:00100000:1.0:1788837898.427769:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037032192 00000100:00100000:1.0:1788837898.427771:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037032192 00000100:00100000:1.0:1788837898.428114:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837898.428120:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875732037031552:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788837898.428147:0:19019:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:1.0:1788837898.428173:0:19019:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926af0392 00002000:00100000:1.0:1788837898.428188:0:19019:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8899c277c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1788837898.428325:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732037032448:12345-0@lo:400:kworker.0 Request processed in 1553us (2747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837898.428333:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788837898.428371:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837898.428376:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875732037031680:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788837898.428388:0:18709:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00002000:00080000:1.0:1788837898.429292:0:19019:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788837898.429295:0:19019:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788837898.429383:0:19019:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788837898.429412:0:19019:0:(import.c:65:import_set_state_nolock()) ffff8899c277a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837898.429480:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875732037031552:12345-0@lo:8:kworker.0 Request processed in 1357us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837898.429488:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837898.429513:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788837898.429519:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875732037032192:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788837898.429552:0:19019:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788837898.429582:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875732037032192:12345-0@lo:8:kworker.0 Request processed in 61us (1943us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788837898.429589:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788837898.429632:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c3dd4700 x1875732037031552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788837923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837898.429642:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788837898.429649:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788837898.429656:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788837898.429661:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788837898.429663:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889ad114d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788837898.429678:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788837898.429683:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037031552:0@lo:8:kworker.0 00000100:00080000:1.0:1788837898.429697:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837898.429701:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788837898.429704:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037032192:0@lo:8:kworker.0 00010000:00080000:3.0:1788837898.429918:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c446d180 x1875732037032448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837898.429928:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037032448:0@lo:400:kworker.0 00000004:00080000:3.0:1788837898.429993:0:17225:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1788837898.430013:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1875732037032832:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788837898.430067:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837898.430091:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded0b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837898.430103:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837898.430112:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037032704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837898.430137:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837898.430168:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037032704 00000100:00100000:3.0:1788837898.430173:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037032704 00000100:00100000:0.0:1788837898.430318:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037032832 00000100:00100000:0.0:1788837898.430323:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037032832 00000100:00100000:0.0:1788837898.430357:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788837898.430365:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:17225:x1875732037032832:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788837898.430588:0:17224:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788837898.430668:0:17224:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 515301891215ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788837898.430676:0:17224:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788837898.432298:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837898.432315:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875732037032704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837898.432357:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788837898.432439:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875732037032704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837898.432446:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788837898.432472:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788837898.432505:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c4490e00 x1875732037032704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837898.432525:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037032704:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1788837898.440988:0:18707:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788837898.441005:0:18707:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788837898.441012:0:18707:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:1.0:1788837898.465442:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875732037031680:12345-0@lo:8:kworker.0 Request processed in 37054us (37835us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788837898.465458:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788837898.465513:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837898.465519:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788837898.465523:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037031680:0@lo:8:kworker.0 00002000:00010000:1.0:1788837898.505153:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837898.505168:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af0399 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.505210:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1788837898.505215:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837898.505222:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af0399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.505240:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af0399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.505250:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af0399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.505258:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af0399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.505278:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837898.505821:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837898.505829:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af0399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.505839:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837898.505843:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af0399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.505852:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af0399 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.505873:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af0399 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.505881:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af0399 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.505900:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.505908:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.505910:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788837898.506968:0:17180:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788837898.507136:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837898.507144:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af03a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.507158:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788837898.507162:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837898.507168:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af03a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.507181:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af03a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.507272:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af03a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.507279:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af03a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.507301:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837898.507500:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837898.507507:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af03a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.507516:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837898.507520:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af03a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.507529:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af03a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.507543:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af03a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.507551:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e26bc12b/0x57f6d4e926af03a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.507569:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.507570:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.507572:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837898.508317:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837898.508326:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af03a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.508338:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788837898.508342:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837898.508347:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af03a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.508358:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af03a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.508366:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af03a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.508373:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af03a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.508449:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788837898.511231:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.511243:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077604717/0x57f6d4e926af03ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.511260:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.511264:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.511271:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077604717/0x57f6d4e926af03ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.511300:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077604717/0x57f6d4e926af03ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.511310:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077604717/0x57f6d4e926af03ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.511317:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077604717/0x57f6d4e926af03ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.517027:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837898.517043:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af03a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.517057:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837898.517063:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af03a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.517073:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af03a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.517109:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af03a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.517116:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffeb3bae/0x57f6d4e926af03a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.517139:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837898.517144:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077604717/0x57f6d4e926af03ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.517151:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837898.517155:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077604717/0x57f6d4e926af03ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.517162:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077604717/0x57f6d4e926af03ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.517171:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077604717/0x57f6d4e926af03ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.517178:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837898.517180:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837898.517182:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837898.518971:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788837898.518984:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077604717/0x57f6d4e926af03ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.519277:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788837898.522262:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.522275:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088676c06/0x57f6d4e926af03b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.522294:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.522299:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.522305:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088676c06/0x57f6d4e926af03b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.522320:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088676c06/0x57f6d4e926af03b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.522345:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088676c06/0x57f6d4e926af03b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.522354:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088676c06/0x57f6d4e926af03b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.522384:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837898.522684:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837898.522691:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088676c06/0x57f6d4e926af03b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.522699:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324e00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837898.522703:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088676c06/0x57f6d4e926af03b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.522711:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088676c06/0x57f6d4e926af03b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.522740:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088676c06/0x57f6d4e926af03b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.522748:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088676c06/0x57f6d4e926af03b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.522764:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.522766:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.522767:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788837898.524006:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.524016:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8cef85f/0x57f6d4e926af03bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.524031:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.524036:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.524041:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cef85f/0x57f6d4e926af03bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.524053:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8cef85f/0x57f6d4e926af03bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.524060:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8cef85f/0x57f6d4e926af03bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.524069:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cef85f/0x57f6d4e926af03bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.524112:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837898.524269:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837898.524276:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8cef85f/0x57f6d4e926af03bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.524285:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837898.524297:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8cef85f/0x57f6d4e926af03bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.524306:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8cef85f/0x57f6d4e926af03bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.524322:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8cef85f/0x57f6d4e926af03bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.524329:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8cef85f/0x57f6d4e926af03bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.524347:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.524349:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.524350:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788837898.525031:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.525039:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089698643/0x57f6d4e926af03c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525051:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.525055:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.525060:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089698643/0x57f6d4e926af03c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525070:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089698643/0x57f6d4e926af03c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525078:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089698643/0x57f6d4e926af03c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525086:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089698643/0x57f6d4e926af03c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525106:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837898.525270:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837898.525275:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089698643/0x57f6d4e926af03c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.525283:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837898.525288:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089698643/0x57f6d4e926af03c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.525296:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089698643/0x57f6d4e926af03c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.525309:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089698643/0x57f6d4e926af03c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.525323:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089698643/0x57f6d4e926af03c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.525338:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.525340:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.525342:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788837898.525584:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.525591:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b74d77b/0x57f6d4e926af03ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525600:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.525609:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.525614:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b74d77b/0x57f6d4e926af03ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525623:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b74d77b/0x57f6d4e926af03ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525631:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b74d77b/0x57f6d4e926af03ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525638:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b74d77b/0x57f6d4e926af03ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525659:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788837898.525924:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.525930:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004121c443/0x57f6d4e926af03d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525938:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.525942:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.525947:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004121c443/0x57f6d4e926af03d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525955:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004121c443/0x57f6d4e926af03d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525963:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004121c443/0x57f6d4e926af03d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525978:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004121c443/0x57f6d4e926af03d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.525994:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788837898.526121:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837898.526127:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b74d77b/0x57f6d4e926af03ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.526138:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837898.526141:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b74d77b/0x57f6d4e926af03ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.526149:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b74d77b/0x57f6d4e926af03ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.526161:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b74d77b/0x57f6d4e926af03ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.526168:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b74d77b/0x57f6d4e926af03ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.526183:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837898.526186:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004121c443/0x57f6d4e926af03d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.526209:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1325600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837898.526212:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004121c443/0x57f6d4e926af03d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.526220:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004121c443/0x57f6d4e926af03d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.526230:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004121c443/0x57f6d4e926af03d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.526237:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004121c443/0x57f6d4e926af03d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.526251:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.526252:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.526254:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.526360:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788837898.526974:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.526982:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8c3fa63/0x57f6d4e926af03d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.526993:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.526997:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.527003:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8c3fa63/0x57f6d4e926af03d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.527013:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8c3fa63/0x57f6d4e926af03d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.527021:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8c3fa63/0x57f6d4e926af03d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.527029:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8c3fa63/0x57f6d4e926af03d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.527045:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788837898.527995:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.528005:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f845427/0x57f6d4e926af03df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.528024:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.528306:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.528314:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f845427/0x57f6d4e926af03df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.528327:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f845427/0x57f6d4e926af03df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.528336:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f845427/0x57f6d4e926af03df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.528343:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f845427/0x57f6d4e926af03df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.528370:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788837898.528537:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837898.528545:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8c3fa63/0x57f6d4e926af03d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.528566:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837898.528571:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8c3fa63/0x57f6d4e926af03d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.528580:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8c3fa63/0x57f6d4e926af03d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.528596:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8c3fa63/0x57f6d4e926af03d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.528604:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8c3fa63/0x57f6d4e926af03d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.528622:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837898.528626:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f845427/0x57f6d4e926af03df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.528632:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dbc00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837898.528635:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f845427/0x57f6d4e926af03df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.528643:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f845427/0x57f6d4e926af03df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.528652:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f845427/0x57f6d4e926af03df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.528666:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f845427/0x57f6d4e926af03df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.528678:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.528680:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.528682:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.528753:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788837898.532333:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.532346:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f363d005/0x57f6d4e926af03e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.532362:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.532366:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.532372:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f363d005/0x57f6d4e926af03e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.532386:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f363d005/0x57f6d4e926af03e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.532414:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f363d005/0x57f6d4e926af03e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.532422:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f363d005/0x57f6d4e926af03e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.532443:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837898.532848:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837898.532856:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f363d005/0x57f6d4e926af03e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.532865:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837898.532870:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f363d005/0x57f6d4e926af03e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.532878:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f363d005/0x57f6d4e926af03e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.532896:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f363d005/0x57f6d4e926af03e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.532904:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f363d005/0x57f6d4e926af03e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.532920:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.532922:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.532923:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788837898.533111:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.533117:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af03ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.533126:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.533129:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.533133:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af03ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.533142:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af03ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.533149:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af03ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.533157:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af03ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.533193:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788837898.534340:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.534349:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af03f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.534361:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.534365:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.534370:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af03f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.534380:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af03f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.534388:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af03f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.534396:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af03f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.534419:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788837898.534575:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837898.534582:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af03ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.534604:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837898.534608:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af03ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.534617:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af03ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.534632:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af03ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.534638:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af03ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.534655:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837898.534658:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af03f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.534664:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837898.534667:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af03f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.534675:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af03f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.534683:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af03f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.534696:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddd0a8c4/0x57f6d4e926af03f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.534708:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837898.534710:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837898.534712:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.535195:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788837898.535981:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.535991:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043448fe6/0x57f6d4e926af03fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.536005:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.536019:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.536025:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043448fe6/0x57f6d4e926af03fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.536037:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043448fe6/0x57f6d4e926af03fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.536045:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043448fe6/0x57f6d4e926af03fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.536051:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043448fe6/0x57f6d4e926af03fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.536067:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837898.536353:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837898.536361:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043448fe6/0x57f6d4e926af03fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.536369:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837898.536373:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043448fe6/0x57f6d4e926af03fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.536382:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043448fe6/0x57f6d4e926af03fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.536398:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043448fe6/0x57f6d4e926af03fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.536405:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043448fe6/0x57f6d4e926af03fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.536422:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.536424:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.536426:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788837898.538562:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.538574:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018b075fe/0x57f6d4e926af0402 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.538590:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.538593:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.538599:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018b075fe/0x57f6d4e926af0402 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.538611:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018b075fe/0x57f6d4e926af0402 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.538620:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018b075fe/0x57f6d4e926af0402 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.538638:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018b075fe/0x57f6d4e926af0402 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.538657:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837898.539143:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837898.539151:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018b075fe/0x57f6d4e926af0402 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.539160:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837898.539165:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018b075fe/0x57f6d4e926af0402 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.539174:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018b075fe/0x57f6d4e926af0402 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.539200:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018b075fe/0x57f6d4e926af0402 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.539208:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018b075fe/0x57f6d4e926af0402 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.539224:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837898.539226:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837898.539228:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788837898.541059:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.541072:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec2530f/0x57f6d4e926af0409 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.541086:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.541090:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.541096:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bec2530f/0x57f6d4e926af0409 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.541107:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bec2530f/0x57f6d4e926af0409 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.541115:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec2530f/0x57f6d4e926af0409 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.541123:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bec2530f/0x57f6d4e926af0409 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.541148:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837898.541450:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837898.541459:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bec2530f/0x57f6d4e926af0409 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.541467:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837898.541471:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec2530f/0x57f6d4e926af0409 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.541493:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec2530f/0x57f6d4e926af0409 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.541509:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bec2530f/0x57f6d4e926af0409 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.541516:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bec2530f/0x57f6d4e926af0409 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.541535:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.541537:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.541538:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788837898.541623:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837898.541629:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099ba8e93/0x57f6d4e926af0410 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.541644:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788837898.541647:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837898.541651:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099ba8e93/0x57f6d4e926af0410 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.541660:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099ba8e93/0x57f6d4e926af0410 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.541667:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099ba8e93/0x57f6d4e926af0410 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.541674:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099ba8e93/0x57f6d4e926af0410 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.541734:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788837898.546939:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837898.546954:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0417 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.546970:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1788837898.546975:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837898.546981:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0417 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.546996:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0417 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.547006:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0417 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.547014:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0417 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.553133:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837898.553150:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099ba8e93/0x57f6d4e926af0410 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.553166:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dac00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837898.553172:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099ba8e93/0x57f6d4e926af0410 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.553185:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099ba8e93/0x57f6d4e926af0410 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.553221:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099ba8e93/0x57f6d4e926af0410 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.553251:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099ba8e93/0x57f6d4e926af0410 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.553411:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837898.553416:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0417 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.553423:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837898.553426:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0417 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.553435:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0417 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.553445:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0417 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.553453:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.553455:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.553456:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837898.556397:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788837898.556413:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0417 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.556762:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.556769:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837898.557365:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837898.557373:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af041e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.557386:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1788837898.557391:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837898.557404:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af041e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.557416:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af041e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.557425:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af041e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.557432:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af041e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.557454:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788837898.559056:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837898.559068:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007708f899/0x57f6d4e926af0425 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.559083:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1788837898.559086:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837898.559091:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007708f899/0x57f6d4e926af0425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.559102:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007708f899/0x57f6d4e926af0425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.559110:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007708f899/0x57f6d4e926af0425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.559130:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007708f899/0x57f6d4e926af0425 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.559151:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788837898.563087:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837898.563101:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbfe38d7/0x57f6d4e926af042c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.563119:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1788837898.563123:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837898.563130:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbfe38d7/0x57f6d4e926af042c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.563143:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbfe38d7/0x57f6d4e926af042c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.563153:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbfe38d7/0x57f6d4e926af042c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.563160:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbfe38d7/0x57f6d4e926af042c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.573006:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788837898.575016:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837898.575030:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0433 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.575056:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=515s v=(0 0) 00010000:00010000:1.0:1788837898.575060:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837898.575067:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.575080:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.575090:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837898.575098:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0433 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.577913:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788837898.577927:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af041e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.577941:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837898.577947:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af041e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.577957:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af041e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.577993:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af041e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578001:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000818279d0/0x57f6d4e926af041e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578027:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788837898.578031:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007708f899/0x57f6d4e926af0425 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578038:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837898.578041:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007708f899/0x57f6d4e926af0425 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578049:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007708f899/0x57f6d4e926af0425 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578058:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007708f899/0x57f6d4e926af0425 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578066:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007708f899/0x57f6d4e926af0425 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578078:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837898.578082:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbfe38d7/0x57f6d4e926af042c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578095:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837898.578098:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbfe38d7/0x57f6d4e926af042c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578106:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbfe38d7/0x57f6d4e926af042c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578115:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbfe38d7/0x57f6d4e926af042c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578122:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbfe38d7/0x57f6d4e926af042c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578135:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837898.578138:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0433 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578143:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837898.578146:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0433 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578154:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0433 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578163:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0433 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.578177:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837898.578178:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837898.578180:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.579163:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837898.579175:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837898.584959:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788837898.584974:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081575d98/0x57f6d4e926af0433 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.585268:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788837898.591402:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837898.591415:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000be614a8/0x57f6d4e926af043a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.591440:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788837898.591444:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837898.591450:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000be614a8/0x57f6d4e926af043a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.591464:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000be614a8/0x57f6d4e926af043a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.591474:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000be614a8/0x57f6d4e926af043a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.591481:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000be614a8/0x57f6d4e926af043a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.591506:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837898.592211:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837898.592219:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000be614a8/0x57f6d4e926af043a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.592227:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837898.592232:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000be614a8/0x57f6d4e926af043a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.592254:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000be614a8/0x57f6d4e926af043a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.592272:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000be614a8/0x57f6d4e926af043a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.592279:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000be614a8/0x57f6d4e926af043a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.592300:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.592301:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.592303:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788837898.593484:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837898.593495:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a339491a/0x57f6d4e926af0441 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.593510:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788837898.593514:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837898.593520:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a339491a/0x57f6d4e926af0441 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.593531:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a339491a/0x57f6d4e926af0441 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.593554:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a339491a/0x57f6d4e926af0441 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.593562:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a339491a/0x57f6d4e926af0441 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.593584:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837898.593828:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837898.593835:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a339491a/0x57f6d4e926af0441 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.593843:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837898.593848:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a339491a/0x57f6d4e926af0441 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.593857:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a339491a/0x57f6d4e926af0441 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.593873:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a339491a/0x57f6d4e926af0441 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.593892:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a339491a/0x57f6d4e926af0441 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837898.593910:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.593912:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.593913:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788837898.595130:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837898.595142:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6cb8239/0x57f6d4e926af0448 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.595157:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788837898.595161:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837898.595167:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6cb8239/0x57f6d4e926af0448 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.595179:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6cb8239/0x57f6d4e926af0448 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.595889:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6cb8239/0x57f6d4e926af0448 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.595903:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6cb8239/0x57f6d4e926af0448 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.595955:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788837898.596994:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837898.597004:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000477a6b7/0x57f6d4e926af044f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.597018:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788837898.597022:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837898.597029:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000477a6b7/0x57f6d4e926af044f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.597041:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000477a6b7/0x57f6d4e926af044f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.597050:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000477a6b7/0x57f6d4e926af044f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.597057:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000477a6b7/0x57f6d4e926af044f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837898.597075:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1788837898.597120:0:18707:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:2.0:1788837898.597970:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837898.597979:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6cb8239/0x57f6d4e926af0448 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.597990:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837898.597995:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6cb8239/0x57f6d4e926af0448 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.598005:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6cb8239/0x57f6d4e926af0448 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.598024:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6cb8239/0x57f6d4e926af0448 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.598031:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6cb8239/0x57f6d4e926af0448 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.598052:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837898.598055:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000477a6b7/0x57f6d4e926af044f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.598061:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837898.598077:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000477a6b7/0x57f6d4e926af044f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.598085:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000477a6b7/0x57f6d4e926af044f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.598095:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000477a6b7/0x57f6d4e926af044f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.598102:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000477a6b7/0x57f6d4e926af044f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837898.598115:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837898.598117:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837898.598119:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837898.598897:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837898.598949:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17225:x1875732037032832:12345-0@lo:5:osp-pre-0-0.0 Request processed in 168578us (168875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837898.598961:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788837898.599099:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1875732037032832:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788837898.599115:0:17225:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788837898.599158:0:17225:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1875732037032960:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788837898.599387:0:17225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837898.600979:0:17225:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac91d8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788837898.608673:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037032960 00000100:00100000:0.0:1788837898.608690:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037032960 00000100:00100000:0.0:1788837898.608791:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788837898.609181:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17225:x1875732037032960:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788837898.609293:0:18708:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:3.0:1788837898.644330:0:18703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1788837898.644410:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788837898.649285:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17225:x1875732037032960:12345-0@lo:5:osp-pre-0-0.0 Request processed in 40101us (49888us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788837898.649299:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788837898.658339:0:17225:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788837898.658357:0:17225:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1875732037032960:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788837898.658376:0:17225:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:0.0:1788837899.577093:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837899.714471:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837899.714495:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037033088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837899.714562:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837899.714687:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037033088 00000100:00100000:2.0:1788837899.714706:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037033088 00000100:00100000:2.0:1788837899.714794:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837899.714804:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037033088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837899.714827:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788837899.714879:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037033088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837899.714886:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837899.715051:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037033088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837900.217318:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837900.217340:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037033344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837900.217404:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837900.217446:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037033344 00000100:00100000:0.0:1788837900.217452:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037033344 00000100:00100000:0.0:1788837900.217493:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788837900.217501:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037033344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837900.217533:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788837900.217569:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037033344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837900.217576:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788837900.217614:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037033344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837900.217974:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037033216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837900.218006:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837900.218041:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037033216 00000100:00100000:1.0:1788837900.218044:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037033216 00000100:00100000:1.0:1788837900.218072:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788837900.218078:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037033216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788837900.218095:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788837900.218138:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037033216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837900.218145:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788837900.218171:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037033216:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788837900.605880:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837901.188195:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788837901.631868:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837902.650309:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837903.673982:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788837903.803336:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837903.803343:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788837903.803346:0:37:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837903.803354:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:1.0:1788837903.803358:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788837903.803364:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8899c21e7000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837903.803387:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ac85e8700 x1875732037033856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837903.803420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788837903.803423:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788837903.803425:0:37:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837903.803428:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 515 00000100:00080000:1.0:1788837903.803430:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788837903.803435:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff889af8dbc000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837903.803445:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c27be300 x1875732037034368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837903.803486:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037033984:0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.804154:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837903.804207:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732037034624:0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.804232:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837903.804261:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788837903.804266:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037033472:0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.804292:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837903.804309:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037034112:0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.804332:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837903.804348:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037034752:0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.804368:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837903.804396:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037033600:0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.804420:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837903.804436:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037034240:0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.804457:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837903.804476:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788837903.804481:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037033728:0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.804500:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837903.804517:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037034496:0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.804534:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837903.804558:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037033856:0@lo:8:kworker.0 00000100:00100000:1.0:1788837903.804580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837903.804596:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037034368:0@lo:8:kworker.0 00000100:00100000:1.0:1788837903.804613:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837903.804653:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037033984 00000100:00100000:1.0:1788837903.804669:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037033984 00000100:00100000:1.0:1788837903.804702:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037034624 00000100:00100000:1.0:1788837903.804705:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037034624 00000100:00100000:1.0:1788837903.804728:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037034752 00000100:00100000:1.0:1788837903.804731:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037034752 00000100:00100000:1.0:1788837903.804740:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037034496 00000100:00100000:1.0:1788837903.804742:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037034496 00000100:00100000:1.0:1788837903.804755:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788837903.804762:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037033984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.804828:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875732037033984:12345-0@lo:400:kworker.0 Request processed in 65us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837903.804835:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788837903.804851:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788837903.804856:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732037034624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.804881:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732037034624:12345-0@lo:400:kworker.0 Request processed in 25us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837903.805500:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037034240 00000100:00100000:3.0:1788837903.805506:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037034240 00000100:00100000:3.0:1788837903.805534:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037033728 00000100:00100000:3.0:1788837903.805536:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037033728 00000100:00100000:3.0:1788837903.805547:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037033856 00000100:00100000:3.0:1788837903.805550:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037033856 00000100:00100000:3.0:1788837903.805558:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037034368 00000100:00100000:3.0:1788837903.805560:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037034368 00000100:00100000:3.0:1788837903.805570:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837903.805577:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037034240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837903.805635:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037034240:12345-0@lo:400:kworker.0 Request processed in 58us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837903.805641:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788837903.805654:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837903.805660:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037033728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837903.805687:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037033728:12345-0@lo:400:kworker.0 Request processed in 28us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837903.805693:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837903.805704:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837903.805708:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037033856:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788837903.805726:0:18707:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837903.805769:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037033856:12345-0@lo:8:kworker.0 Request processed in 58us (1187us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837903.805789:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837903.805802:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788837903.805806:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037034368:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788837903.805815:0:18707:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837903.805838:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037034368:12345-0@lo:8:kworker.0 Request processed in 31us (1224us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837903.805844:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788837903.806101:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837903.806107:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837903.806112:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037033856:0@lo:8:kworker.0 00000100:00080000:3.0:1788837903.806126:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837903.806130:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837903.806133:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037034368:0@lo:8:kworker.0 00000100:00100000:3.0:1788837903.806163:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037034880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837903.806195:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837903.806224:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037033728:0@lo:400:kworker.0 00000100:00100000:3.0:1788837903.806235:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037034240:0@lo:400:kworker.0 00000100:00100000:3.0:1788837903.806261:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037034880 00000100:00100000:3.0:1788837903.806265:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037034880 00000100:00100000:3.0:1788837903.806290:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837903.806296:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037034880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837903.806317:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788837903.806358:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037034880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837903.806364:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837903.806396:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037034880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837903.806577:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788837903.806596:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837903.806604:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037034752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.806649:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037034752:12345-0@lo:400:kworker.0 Request processed in 47us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837903.806655:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837903.806667:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837903.806672:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037034496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.806712:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037034496:12345-0@lo:400:kworker.0 Request processed in 40us (2176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837903.806718:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788837903.806751:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037033472 00000100:00100000:1.0:1788837903.806756:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037033472 00000100:00100000:1.0:1788837903.806799:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788837903.806806:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:3650:x1875732037033472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.806837:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:3650:x1875732037033472:12345-0@lo:400:kworker.0 Request processed in 31us (2543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837903.806843:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788837903.806868:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037034112 00000100:00100000:1.0:1788837903.806872:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037034112 00000100:00100000:1.0:1788837903.806899:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037033600 00000100:00100000:1.0:1788837903.806902:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037033600 00000100:00100000:1.0:1788837903.806913:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788837903.806918:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afa5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037034112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.806946:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afa5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037034112:12345-0@lo:400:kworker.0 Request processed in 27us (2613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837903.806950:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788837903.806960:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788837903.806965:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037033600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.806987:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037033600:12345-0@lo:400:kworker.0 Request processed in 23us (2566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837903.806992:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788837903.807026:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837903.807030:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837903.807032:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788837903.807070:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037033472:0@lo:400:kworker.0 00000100:00100000:1.0:1788837903.807521:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037034112:0@lo:400:kworker.0 00010000:00080000:1.0:1788837903.807540:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c27bdf80 x1875732037034752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837903.807560:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037034752:0@lo:400:kworker.0 00010000:00080000:1.0:1788837903.807574:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ac85ea680 x1875732037033984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837903.807582:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875732037033984:0@lo:400:kworker.0 00010000:00080000:1.0:1788837903.807593:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c27bdc00 x1875732037034624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837903.807600:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732037034624:0@lo:400:kworker.0 00010000:00080000:3.0:1788837903.807828:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c27bea00 x1875732037034496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837903.807838:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037034496:0@lo:400:kworker.0 00000100:00100000:3.0:1788837903.807848:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037033600:0@lo:400:kworker.0 00000020:01000004:0.0:1788837904.684864:0:19522:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788837904.684869:0:19522:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788837904.684870:0:19522:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788837904.684976:0:19522:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8899c36d1800 00000020:01000004:0.0:1788837904.684991:0:19522:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788837904.685005:0:19522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788837904.685018:0:19522:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff889af99a99b8) 00000020:00000080:0.0:1788837904.685034:0:19522:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1788837904.697221:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788837904.735324:0:19522:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788837904.740679:0:19522:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788837904.741299:0:19522:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788837904.745522:0:19522:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788837904.746382:0:19522:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788837904.746706:0:19522:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788837904.746927:0:19522:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1788837904.751701:0:19522:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788837904.752025:0:19522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788837904.752041:0:19522:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788837904.752052:0:19522:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x57f6d4e926af045d 00000020:01000004:1.0:1788837904.752059:0:19522:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788837904.752082:0:19522:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788837904.752086:0:19522:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788837904.752091:0:19522:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788837904.752121:0:19522:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788837904.752125:0:19522:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788837904.764735:0:19522:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788837904.764979:0:19522:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.103@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788837904.764985:0:19522:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788837904.764986:0:19522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788837904.764994:0:19522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837904.764995:0:19522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837904.764996:0:19522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837904.764997:0:19522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837904.764999:0:19522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788837904.765000:0:19522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837904.765001:0:19522:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788837904.765005:0:19522:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788837904.765006:0:19522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788837904.765007:0:19522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788837904.765008:0:19522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837904.765009:0:19522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837904.765010:0:19522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837904.765011:0:19522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837904.765012:0:19522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788837904.765013:0:19522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837904.765013:0:19522:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788837904.765048:0:19522:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788837904.765130:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035008:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788837904.765202:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837904.765250:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af745b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837904.765316:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037035008 00000100:00100000:3.0:1788837904.765324:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037035008 00000100:00100000:3.0:1788837904.766388:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788837904.766403:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:19522:x1875732037035008:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788837904.766437:0:17194:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788837904.766440:0:17194:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788837904.766444:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788837904.767252:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:19522:x1875732037035008:12345-0@lo:253:mount.lustre.0 Request processed in 850us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837904.767260:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788837904.767348:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035008:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788837904.767361:0:19522:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788837904.767363:0:19522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788837904.767365:0:19522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788837904.767366:0:19522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837904.767367:0:19522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837904.767369:0:19522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837904.767369:0:19522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837904.767371:0:19522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837904.767372:0:19522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837904.767373:0:19522:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788837904.767392:0:19522:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8899c36d1800 from lustre-OST0001 10000000:01000000:0.0:1788837904.767421:0:19522:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788837904.767424:0:19522:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788837904.767432:0:19522:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8899c364b370 local copy 00010000:00010000:0.0:1788837904.767442:0:19522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837904.767562:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837904.767598:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837904.770321:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6922c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837904.770437:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037035136 00000100:00100000:1.0:1788837904.770448:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037035136 00000100:00100000:0.0:1788837904.770674:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788837904.770686:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:19522:x1875732037035136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837904.770841:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:19522:x1875732037035136:12345-0@lo:501:mount.lustre.0 Request processed in 157us (3241us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788837904.770849:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788837904.771120:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035136:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788837904.771145:0:19522:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788837904.771174:0:19522:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788837904.771183:0:19522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837904.771192:0:19522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac1324800/0x57f6d4e926af00b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af00ba expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837904.771220:0:19522:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8899c36d1800 10000000:01000000:1.0:1788837904.771225:0:19522:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788837904.771239:0:19522:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788837904.771243:0:19522:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788837904.771247:0:19522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788837904.771250:0:19522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788837904.771280:0:19522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837904.771288:0:19522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837904.771297:0:19522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837904.771315:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788837904.771352:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837904.771371:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adea1ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837904.772199:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037035264 00000100:00100000:3.0:1788837904.772207:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037035264 00000100:00100000:3.0:1788837904.772246:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788837904.772256:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:19522:x1875732037035264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788837904.772267:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837904.772280:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afbea7e00/0x57f6d4e926af046b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0464 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837904.772317:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afbea7e00/0x57f6d4e926af046b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0464 expref: 22 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837904.772327:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afbea7e00/0x57f6d4e926af046b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0464 expref: 22 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837904.772334:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea7e00, rc 0) 00000100:00100000:3.0:1788837904.772395:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:19522:x1875732037035264:12345-0@lo:101:mount.lustre.0 Request processed in 140us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837904.772402:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788837904.772495:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788837904.772510:0:19522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af046b expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837904.772520:0:19522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af046b expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788837904.775345:0:19522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788837904.776243:0:19522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788837904.779772:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788837904.780128:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788837904.780144:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788837904.780157:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788837904.780172:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788837904.780186:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788837904.780213:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788837904.780219:0:19522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788837904.780332:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837904.780405:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837904.780861:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6b62300 going to sleep for 11 seconds 00000100:00100000:1.0:1788837904.780939:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037035392 00000100:00100000:1.0:1788837904.780946:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037035392 00000100:00100000:1.0:1788837904.780980:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788837904.780986:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:19522:x1875732037035392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837904.781131:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:19522:x1875732037035392:12345-0@lo:501:mount.lustre.0 Request processed in 144us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837904.781137:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788837904.781271:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837904.781297:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837904.781369:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837904.781425:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6b62300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837904.784675:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037035520 00000100:00100000:2.0:1788837904.784690:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037035520 00000100:00100000:2.0:1788837904.784805:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788837904.784826:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:19522:x1875732037035520:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837904.786054:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:19522:x1875732037035520:12345-0@lo:503:mount.lustre.0 Request processed in 1224us (4676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837904.786065:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788837904.786179:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035520:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788837904.786541:0:19522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788837904.786745:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788837904.786839:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837904.789151:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6b62300 going to sleep for 11 seconds 00000100:00100000:1.0:1788837904.789240:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037035648 00000100:00100000:1.0:1788837904.789251:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037035648 00000100:00100000:1.0:1788837904.789302:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788837904.789312:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:19522:x1875732037035648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788837904.789893:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:19522:x1875732037035648:12345-0@lo:502:mount.lustre.0 Request processed in 581us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837904.789902:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788837904.790088:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788837904.790327:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788837904.790360:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788837904.790376:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788837904.790391:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788837904.790405:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788837904.790419:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788837904.790433:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788837904.790446:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788837904.790460:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788837904.790492:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788837904.790538:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837904.792193:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6b62300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837904.792324:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037035776 00000100:00100000:2.0:1788837904.792334:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037035776 00000100:00100000:1.0:1788837904.792517:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788837904.792529:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:19522:x1875732037035776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788837904.792718:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:19522:x1875732037035776:12345-0@lo:502:mount.lustre.0 Request processed in 191us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837904.792725:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788837904.793058:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788837904.793134:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788837904.793146:0:19522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788837904.795050:0:19526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788837904.795061:0:19526:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788837904.795068:0:19526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837904.795070:0:19526:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788837904.795080:0:19526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788837904.795096:0:19526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff889ae7f3b370) 00000020:00000080:1.0:1788837904.795122:0:19526:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788837904.795128:0:19526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788837904.795219:0:19526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8899c36d1800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788837904.795227:0:19526:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788837904.795234:0:19526:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x57f6d4e926af0479 00010000:00010000:1.0:1788837904.800541:0:19526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788837904.801452:0:19526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788837904.804927:0:19526:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788837904.806645:0:19526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788837904.806657:0:19526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837904.806664:0:19526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837904.806666:0:19526:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788837904.806669:0:19526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837904.806673:0:19526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837904.806674:0:19526:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788837904.806677:0:19526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788837904.806679:0:19526:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788837904.806681:0:19526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837904.806683:0:19526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837904.806684:0:19526:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788837904.806686:0:19526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837904.806688:0:19526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837904.806690:0:19526:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788837904.806694:0:19526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788837904.806719:0:19526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837904.806723:0:19526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837904.806724:0:19526:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788837904.806727:0:19526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788837904.807920:0:19522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788837904.807958:0:19522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788837904.807987:0:19522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af046b expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.808000:0:19522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c8c00/0x57f6d4e926af0464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af046b expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837904.808008:0:19522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8899c36d1800 from 1 10000000:01000000:0.0:1788837904.808011:0:19522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837904.808053:0:19522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.808061:0:19522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.808072:0:19522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837904.808100:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837904.808177:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837904.808217:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6922240 going to sleep for 11 seconds 00000100:00100000:0.0:1788837904.808243:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037035904 00000100:00100000:0.0:1788837904.808250:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037035904 00000100:00100000:0.0:1788837904.808297:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788837904.808305:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:19522:x1875732037035904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837904.808318:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837904.808330:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0487 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0480 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.808352:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0480 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.808363:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0480 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.808372:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9b400, rc 0) 00000100:00100000:0.0:1788837904.808409:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:19522:x1875732037035904:12345-0@lo:101:mount.lustre.0 Request processed in 105us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837904.808415:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788837904.808459:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037035904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837904.808473:0:19522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0487 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.808481:0:19522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0487 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788837904.810409:0:19522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788837904.810981:0:19522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837904.811163:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788837904.811187:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788837904.811206:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788837904.811211:0:19522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788837904.811284:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037036032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837904.811333:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837904.811909:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6922180 going to sleep for 11 seconds 00000100:00100000:1.0:1788837904.815549:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037036032 00000100:00100000:1.0:1788837904.815563:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037036032 00000100:00100000:1.0:1788837904.816041:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788837904.816053:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:19522:x1875732037036032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837904.816231:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:19522:x1875732037036032:12345-0@lo:501:mount.lustre.0 Request processed in 179us (4896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837904.816240:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788837904.816366:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037036032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837904.816418:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037036160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837904.816465:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837904.816535:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad15a2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788837904.820548:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037036160 00000100:00100000:2.0:1788837904.820561:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037036160 00000100:00100000:2.0:1788837904.820630:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788837904.820641:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:19522:x1875732037036160:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837904.821188:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:19522:x1875732037036160:12345-0@lo:503:mount.lustre.0 Request processed in 547us (4720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837904.821196:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788837904.821558:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037036160:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788837904.822033:0:19522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788837904.822115:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037036288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837904.822176:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837904.822253:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6922240 going to sleep for 11 seconds 00000100:00100000:2.0:1788837904.822468:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037036288 00000100:00100000:2.0:1788837904.822479:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037036288 00000100:00100000:2.0:1788837904.822555:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788837904.822565:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:19522:x1875732037036288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837904.822682:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:19522:x1875732037036288:12345-0@lo:502:mount.lustre.0 Request processed in 118us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837904.822689:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788837904.823127:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037036288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788837904.823314:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788837904.823342:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788837904.823356:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788837904.823369:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788837904.823382:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788837904.823394:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788837904.823406:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788837904.823419:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788837904.823433:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788837904.823445:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788837904.823458:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788837904.823495:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037036416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788837904.823538:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837904.823832:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6922240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837904.823974:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037036416 00000100:00100000:1.0:1788837904.823980:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037036416 00000100:00100000:1.0:1788837904.824013:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788837904.824019:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:19522:x1875732037036416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788837904.824120:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:19522:x1875732037036416:12345-0@lo:502:mount.lustre.0 Request processed in 100us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837904.824127:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788837904.824198:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037036416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788837904.824240:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788837904.824247:0:19522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:1.0:1788837904.824991:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037036544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837904.825035:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788837904.825272:0:19530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837904.825289:0:19530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837904.825291:0:19530:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788837904.825297:0:19530:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8899c36d1800 00000020:00000080:0.0:1788837904.825300:0:19530:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788837904.825307:0:19530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837904.825310:0:19530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837904.825311:0:19530:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788837904.825314:0:19530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837904.825316:0:19530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837904.825317:0:19530:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788837904.825320:0:19530:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8899c36d1800 00000020:00000080:0.0:1788837904.825322:0:19530:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788837904.825393:0:19530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837904.825397:0:19530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837904.825399:0:19530:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788837904.825402:0:19530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837904.825405:0:19530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837904.825406:0:19530:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788837904.825409:0:19530:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8899c36d1800 00000020:00000080:0.0:1788837904.825411:0:19530:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788837904.825428:0:19530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837904.825431:0:19530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837904.825433:0:19530:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788837904.825435:0:19530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788837904.825437:0:19530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837904.825439:0:19530:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788837904.825442:0:19530:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8899c36d1800 00000020:00000080:0.0:1788837904.825444:0:19530:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788837904.825464:0:19530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837904.825467:0:19530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837904.825469:0:19530:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788837904.825472:0:19530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788837904.825510:0:19522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788837904.825531:0:19522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788837904.825689:0:19522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0487 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.825701:0:19522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0487 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837904.825742:0:19522:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788837904.825745:0:19522:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8899c36d1800 10000000:01000000:0.0:1788837904.825748:0:19522:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8899c36d1800 10000000:01000000:0.0:1788837904.825751:0:19522:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788837904.825756:0:19522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8899c36d1800 from 1 10000000:01000000:0.0:1788837904.825758:0:19522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788837904.825806:0:19522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.826089:0:19522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.826101:0:19522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837904.826120:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037036672:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788837904.826165:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837904.826191:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6922540 going to sleep for 11 seconds 00000100:00100000:2.0:1788837904.826311:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037036672 00000100:00100000:2.0:1788837904.826318:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037036672 00000100:00100000:2.0:1788837904.826352:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788837904.826361:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:19522:x1875732037036672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837904.826373:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837904.826385:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6db200/0x57f6d4e926af0495 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af048e expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.826407:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6db200/0x57f6d4e926af0495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af048e expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.826416:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6db200/0x57f6d4e926af0495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af048e expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.826424:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6db200, rc 0) 00000100:00100000:2.0:1788837904.826471:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:19522:x1875732037036672:12345-0@lo:101:mount.lustre.0 Request processed in 112us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837904.826478:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788837904.834003:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037036544 00000100:00100000:2.0:1788837904.834019:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037036544 00000100:00100000:2.0:1788837904.834081:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837904.834091:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037036544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837904.834135:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788837904.834221:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037036544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (9185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837904.834229:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837904.834297:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037036544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837904.838748:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037036672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837904.838792:0:19522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0495 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.838806:0:19522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0495 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837904.842706:0:19522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1788837904.843057:0:19522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837904.843261:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788837904.843285:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788837904.843299:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788837904.843327:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788837904.843342:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788837904.843354:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788837904.843366:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788837904.843378:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788837904.843391:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788837904.843403:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788837904.843416:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788837904.843428:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788837904.843440:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788837904.843452:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788837904.843464:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788837904.843476:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788837904.843490:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788837904.843502:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788837904.843513:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788837904.843538:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788837904.843628:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788837904.843643:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788837904.843656:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788837904.843681:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788837904.843694:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788837904.843706:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788837904.843718:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788837904.843730:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788837904.843742:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788837904.843756:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788837904.843770:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788837904.843804:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788837904.844184:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788837904.844203:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788837904.844217:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788837904.844244:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788837904.844258:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788837904.844269:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788837904.844281:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1788837904.844292:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1788837904.844303:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1788837904.844314:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1788837904.844325:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1788837904.844336:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1788837904.844348:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1788837904.844359:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1788837904.844380:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1788837904.844385:0:19522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1788837904.844485:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037036800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837904.844618:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837904.844669:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837904.844729:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037036800 00000100:00100000:1.0:1788837904.844736:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037036800 00000100:00100000:1.0:1788837904.844907:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788837904.844918:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:19522:x1875732037036800:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837904.845040:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:19522:x1875732037036800:12345-0@lo:501:mount.lustre.0 Request processed in 124us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837904.845048:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788837904.845116:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037036800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837904.845145:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037036928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837904.845189:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837904.845202:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837904.845217:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037036928 00000100:00100000:2.0:1788837904.845221:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037036928 00000100:00100000:2.0:1788837904.845240:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788837904.845245:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:19522:x1875732037036928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837904.845315:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:19522:x1875732037036928:12345-0@lo:503:mount.lustre.0 Request processed in 69us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837904.845322:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788837904.845362:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037036928:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788837904.846729:0:19522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788837904.846894:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037037056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837904.846956:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837904.846982:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdc900 going to sleep for 11 seconds 00000100:00100000:2.0:1788837904.847010:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037037056 00000100:00100000:2.0:1788837904.847015:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037037056 00000100:00100000:2.0:1788837904.847065:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788837904.847074:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:19522:x1875732037037056:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837904.847165:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:19522:x1875732037037056:12345-0@lo:502:mount.lustre.0 Request processed in 92us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837904.847173:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788837904.847221:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037037056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837904.847397:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788837904.847419:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788837904.847431:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788837904.847442:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788837904.847463:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788837904.847476:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788837904.847487:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788837904.847498:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788837904.847509:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788837904.847526:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788837904.847539:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788837904.850641:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788837904.850684:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788837904.850701:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788837904.850716:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788837904.850730:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788837904.850745:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788837904.852921:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788837904.852978:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788837904.852994:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788837904.853007:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788837904.853018:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788837904.853032:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788837904.853046:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788837904.853057:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788837904.853069:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788837904.853082:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788837904.853093:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788837904.853104:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788837904.853117:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788837904.853131:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788837904.853143:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788837904.853157:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788837904.853186:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788837904.853202:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788837904.853216:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788837904.853229:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788837904.853253:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788837904.853265:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788837904.853277:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788837904.853289:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788837904.853300:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788837904.853314:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788837904.853327:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788837904.853340:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788837904.853352:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788837904.853365:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788837904.853377:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788837904.853442:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037037184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837904.853522:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837904.854694:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdc900 going to sleep for 11 seconds 00000100:00100000:3.0:1788837904.856748:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037037184 00000100:00100000:3.0:1788837904.856763:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037037184 00000100:00100000:3.0:1788837904.856904:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788837904.856916:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:19522:x1875732037037184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788837904.857077:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:19522:x1875732037037184:12345-0@lo:502:mount.lustre.0 Request processed in 164us (3554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837904.857085:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788837904.857961:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037037184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837904.858172:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788837904.858200:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788837904.858237:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037037312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788837904.858294:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837904.858325:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889adebdc900 going to sleep for 11 seconds 00000100:00100000:3.0:1788837904.858403:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037037312 00000100:00100000:3.0:1788837904.858408:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037037312 00000100:00100000:3.0:1788837904.858450:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788837904.858457:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:19522:x1875732037037312:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788837904.858540:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:19522:x1875732037037312:12345-0@lo:502:mount.lustre.0 Request processed in 83us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837904.858547:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788837904.858909:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037037312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788837904.858953:0:19522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788837904.858962:0:19522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788837904.863034:0:19535:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788837904.863053:0:19535:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8899c3d319b8) 00000020:00000080:3.0:1788837904.863080:0:19535:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788837904.863183:0:19535:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8899c36d1800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788837904.863188:0:19535:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8899c36d1800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788837904.863190:0:19535:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8899c36d1800 3 00010000:00080000:3.0:1788837904.863221:0:19535:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889affb4d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788837904.867742:0:19535:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788837904.868655:0:19535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788837904.868705:0:19535:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788837904.868719:0:19535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x57f6d4e926af04a3 00000100:00080000:3.0:1788837904.868730:0:19535:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788837904.868736:0:19535:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff889affb4d000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837904.868770:0:19535:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c4493b80 x1875732037037440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837904.868847:0:19535:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788837904.868930:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788837904.868934:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788837904.868936:0:37:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837904.868940:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:3.0:1788837904.868944:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788837904.868947:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8899c21e7000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837904.868960:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c27bdc00 x1875732037037824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837904.868989:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788837904.868992:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788837904.868994:0:37:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837904.868996:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 520 00000100:00080000:3.0:1788837904.868999:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788837904.869002:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff889af8dbc000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837904.869013:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c27be300 x1875732037038208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837904.869060:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037037568:0@lo:400:kworker.0 00000100:00100000:3.0:1788837904.869129:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837904.869162:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037038336:0@lo:400:kworker.0 00000100:00100000:3.0:1788837904.869183:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837904.869202:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788837904.869207:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037037696:0@lo:400:kworker.0 00000100:00100000:3.0:1788837904.869237:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837904.869251:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732037038464:0@lo:400:kworker.0 00000100:00100000:3.0:1788837904.869267:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837904.869292:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037037568 00000100:00100000:3.0:1788837904.869299:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037037568 00000100:00100000:3.0:1788837904.869336:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788837904.869343:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037037568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837904.869391:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037037568:12345-0@lo:400:kworker.0 Request processed in 47us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837904.869398:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788837904.869415:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037038336 00000100:00100000:3.0:1788837904.869418:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037038336 00000100:00100000:3.0:1788837904.869438:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037038464 00000100:00100000:3.0:1788837904.869440:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037038464 00000100:00100000:3.0:1788837904.869456:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788837904.869461:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037038336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837904.869487:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037038336:12345-0@lo:400:kworker.0 Request processed in 25us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837904.869492:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788837904.869502:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837904.869508:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732037038464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837904.869530:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875732037038464:12345-0@lo:400:kworker.0 Request processed in 23us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837904.869535:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788837904.869549:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037037696 00000100:00100000:3.0:1788837904.869552:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037037696 00000100:00100000:3.0:1788837904.869575:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837904.869587:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037037696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837904.869689:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037037952:0@lo:400:kworker.0 00000100:00100000:2.0:1788837904.869718:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837904.869749:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732037038592:0@lo:400:kworker.0 00000100:00100000:2.0:1788837904.869773:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837904.869842:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837904.869848:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037038080:0@lo:400:kworker.0 00000100:00100000:2.0:1788837904.869870:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837904.869990:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037037952 00000100:00100000:0.0:1788837904.869994:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037037952 00000100:00100000:0.0:1788837904.870011:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037038592 00000100:00100000:0.0:1788837904.870014:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037038592 00000100:00100000:0.0:1788837904.870025:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788837904.870030:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037037952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837904.870064:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037037952:12345-0@lo:400:kworker.0 Request processed in 34us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837904.870070:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788837904.870081:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788837904.870086:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732037038592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837904.870108:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875732037038592:12345-0@lo:400:kworker.0 Request processed in 23us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837904.870113:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788837904.870143:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c27bdf80 x1875732037037952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837904.870156:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037037952:0@lo:400:kworker.0 00010000:00080000:0.0:1788837904.870166:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ac85eb480 x1875732037038592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837904.870174:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875732037038592:0@lo:400:kworker.0 00010000:00080000:0.0:1788837904.870879:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ac85ea680 x1875732037038464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837904.870891:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875732037038464:0@lo:400:kworker.0 00000100:00100000:0.0:1788837904.870913:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037037568:0@lo:400:kworker.0 00010000:00080000:0.0:1788837904.870924:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889ac85e8a80 x1875732037038336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837904.870930:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037038336:0@lo:400:kworker.0 00000100:00100000:0.0:1788837904.870957:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037038080 00000100:00100000:0.0:1788837904.870960:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037038080 00000100:00100000:0.0:1788837904.870990:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788837904.870998:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037038080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837904.871046:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037038080:12345-0@lo:400:kworker.0 Request processed in 49us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837904.871053:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788837904.871085:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037037440:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788837904.871121:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837904.871138:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037037440 00000100:00100000:0.0:1788837904.871142:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037037440 00000100:00100000:1.0:1788837904.871149:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037037824:0@lo:8:kworker.0 00000100:00100000:0.0:1788837904.871160:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788837904.871164:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875732037037440:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788837904.871171:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788837904.871185:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000100:00100000:1.0:1788837904.871186:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037038208:0@lo:8:kworker.0 00000100:00100000:1.0:1788837904.871204:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788837904.871219:0:17200:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x57f6d4e926af04aa 00000100:00100000:1.0:1788837904.871229:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037037824 00000100:00100000:1.0:1788837904.871232:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037037824 00000004:00100000:0.0:1788837904.871233:0:17200:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788837904.871243:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037038208 00000100:00100000:1.0:1788837904.871245:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037038208 00000100:00100000:1.0:1788837904.871254:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837904.871258:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875732037037824:12345-0@lo:8:kworker.0 00000100:00080000:0.0:1788837904.871263:0:17200:0:(import.c:65:import_set_state_nolock()) ffff8899c36a3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837904.871297:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875732037037440:12345-0@lo:38:llog_process_th.0 Request processed in 131us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837904.871303:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788837904.871334:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037038080:0@lo:400:kworker.0 00000100:00100000:3.0:1788837904.871353:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037037696:12345-0@lo:400:kworker.0 Request processed in 1767us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837904.871360:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837904.871374:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788837904.871378:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037038208:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788837904.871700:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037037696:0@lo:400:kworker.0 00000100:00100000:1.0:1788837904.875126:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875732037037824:12345-0@lo:8:kworker.0 Request processed in 3855us (3942us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788837904.875146:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788837904.876184:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c4493b80 x1875732037037440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837904.876197:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837904.876208:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788837904.876217:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788837904.876222:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788837904.876226:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889affb4d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788837904.876233:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875732037037440:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788837904.876454:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837904.876459:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837904.876463:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788837904.876466:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037037824:0@lo:8:kworker.0 00000020:01000004:1.0:1788837904.876596:0:19535:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788837904.876634:0:19535:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8899c22c99b8) 00000020:00000080:1.0:1788837904.876657:0:19535:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788837904.876756:0:19535:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8899c36d1800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788837904.876760:0:19535:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8899c36d1800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788837904.876763:0:19535:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8899c36d1800 3 00010000:00080000:1.0:1788837904.876807:0:19535:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8899c3d15800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.103@tcp at head 00010000:00010000:1.0:1788837904.878717:0:19535:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788837904.878955:0:19535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788837904.878998:0:19535:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788837904.879009:0:19535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x57f6d4e926af04b8 00000100:00080000:1.0:1788837904.879019:0:19535:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788837904.879024:0:19535:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8899c3d15800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788837904.879058:0:19535:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c3d9d500 x1875732037038720/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837904.879075:0:19535:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788837904.883203:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875732037038208:12345-0@lo:8:kworker.0 Request processed in 11812us (11987us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788837904.883217:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837904.883596:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837904.883618:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837904.883623:0:3647:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788837904.883627:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037038208:0@lo:8:kworker.0 00000100:00100000:1.0:1788837904.883949:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875732037038720:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788837904.884014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788837904.885019:0:19535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788837904.885741:0:19522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788837904.885797:0:19522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788837904.885815:0:19522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0495 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.885826:0:19522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b200/0x57f6d4e926af048e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0495 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837904.885831:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037038720 00000100:00100000:3.0:1788837904.885839:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037038720 00000100:00100000:3.0:1788837904.885875:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837904.885882:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875732037038720:12345-0@lo:38:llog_process_th.0 00000020:01000004:0.0:1788837904.885885:0:19522:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788837904.885890:0:19522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788837904.885891:0:19522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837904.885892:0:19522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837904.885893:0:19522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837904.885894:0:19522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837904.885896:0:19522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837904.885897:0:19522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837904.885898:0:19522:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788837904.885902:0:19522:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788837904.885903:0:19522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788837904.885905:0:19522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788837904.885905:0:19522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837904.885906:0:19522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837904.885907:0:19522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837904.885908:0:19522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837904.885909:0:19522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00010000:00080000:3.0:1788837904.885910:0:17202:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:01000004:0.0:1788837904.885910:0:19522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837904.885911:0:19522:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788837904.885931:0:19522:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000020:00000080:3.0:1788837904.885941:0:17202:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x57f6d4e926af04bf 00000100:00100000:0.0:1788837904.885946:0:19522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037038848:0@lo:253:mount.lustre.0 00000004:00100000:3.0:1788837904.885957:0:17202:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788837904.885987:0:17202:0:(import.c:65:import_set_state_nolock()) ffff8899c4405000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837904.886003:0:19522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837904.886032:0:19522:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6922840 going to sleep for 11 seconds 00000100:00100000:3.0:1788837904.886037:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875732037038720:12345-0@lo:38:llog_process_th.0 Request processed in 155us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837904.886045:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788837904.886086:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8899c3d9d500 x1875732037038720/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837904.886095:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837904.886104:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788837904.886111:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788837904.886115:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788837904.886125:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c3d15800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788837904.886131:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875732037038720:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788837904.886162:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037038848 00000100:00100000:3.0:1788837904.886166:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037038848 00000100:00100000:3.0:1788837904.886200:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788837904.886207:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:19522:x1875732037038848:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788837904.886225:0:17195:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788837904.886237:0:17195:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788837904.891183:0:17195:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788837904.891206:0:17195:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788837904.891236:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788837904.891241:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788837904.891261:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.891278:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8899c1a9a000/0x57f6d4e926af0376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af036f expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.891285:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af037d expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.891291:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.891342:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af037d expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.891355:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0384 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af037d expref: 24 pid: 17192 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837904.891369:0:17216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875732037038976:0@lo:104: 00000100:00100000:0.0:1788837904.891432:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788837904.891478:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8899c1a9a000/0x57f6d4e926af0376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af036f expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.891485:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8899c1a9a000/0x57f6d4e926af0376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af036f expref: 24 pid: 17192 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837904.891493:0:17216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875732037039104:0@lo:104: 00000100:00100000:0.0:1788837904.891512:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837904.891521:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:19522:x1875732037038848:12345-0@lo:253:mount.lustre.0 Request processed in 5313us (5516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837904.891526:0:17216:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6922180 going to sleep for 11 seconds 00000100:00100000:3.0:1788837904.891531:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788837904.891562:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037038976 00000100:00100000:0.0:1788837904.891568:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037038976 00000100:00100000:0.0:1788837904.891602:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037039104 00000100:00100000:0.0:1788837904.891614:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037039104 00000100:00100000:0.0:1788837904.891630:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837904.891637:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+4:17216:x1875732037038976:12345-0@lo:104: 00010000:00010000:0.0:1788837904.891650:0:17184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0384 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.891705:0:17184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788837904.891710:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+4:17216:x1875732037038976:12345-0@lo:104: Request processed in 74us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837904.891724:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837904.891740:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788837904.891745:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:17216:x1875732037039104:12345-0@lo:104: 00010000:00010000:0.0:1788837904.891752:0:17184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0376 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837904.891805:0:17184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788837904.891809:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:17216:x1875732037039104:12345-0@lo:104: Request processed in 64us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837904.891816:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788837904.891853:0:19522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d42f6ebb-a489-4c0b-be2b-e965e16a506d:19522:1875732037038848:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788837904.891941:0:19522:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788837904.891945:0:19522:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788837904.891947:0:19522:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788837904.891948:0:19522:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837904.891949:0:19522:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837904.891950:0:19522:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837904.891951:0:19522:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837904.891953:0:19522:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788837904.891955:0:19522:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837904.891956:0:19522:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788837904.891972:0:19522:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788837904.892271:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837904.892279:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0384 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892287:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac1324c00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837904.892291:0:17953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0384 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892301:0:17953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0384 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837904.892308:0:17953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0384 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837904.892314:0:17953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788837904.892344:0:17953:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0384 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892350:0:17953:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837904.892369:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0384 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892375:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889ac1324c00/0x57f6d4e926af037d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0384 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892386:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837904.892389:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0376 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892406:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6e00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837904.892409:0:17953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0376 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892415:0:17953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0376 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837904.892421:0:17953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0376 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837904.892426:0:17953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788837904.892438:0:17953:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0376 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892444:0:17953:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837904.892457:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0376 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892464:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afbea6e00/0x57f6d4e926af036f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0376 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892476:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837904.892477:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837904.892479:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837904.892498:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3649:1875732037039232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837904.892531:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837904.892565:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037039360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837904.892586:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837904.892651:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037039232 00000100:00100000:2.0:1788837904.892655:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037039232 00010000:00010000:2.0:1788837904.892675:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0384 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af037d expref: 24 pid: 17192 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837904.892692:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037039360 00000100:00100000:2.0:1788837904.892695:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037039360 00010000:00010000:2.0:1788837904.892705:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8899c1a9a000/0x57f6d4e926af0376 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af036f expref: 25 pid: 17192 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837904.892719:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788837904.892725:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+25:3649:x1875732037039232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837904.892736:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837904.892740:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0384 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af037d expref: 25 pid: 17192 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892750:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0384 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af037d expref: 25 pid: 17192 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892765:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837904.892874:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+25:3649:x1875732037039232:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837904.892882:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788837904.892897:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788837904.892903:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3650:x1875732037039360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837904.892912:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837904.892916:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8899c1a9a000/0x57f6d4e926af0376 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af036f expref: 24 pid: 17192 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892924:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8899c1a9a000/0x57f6d4e926af0376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af036f expref: 24 pid: 17192 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892943:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892952:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788837904.892965:0:17186:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016148958s 00010000:00010000:2.0:1788837904.892969:0:17186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892976:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892982:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892987:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.892992:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837904.892995:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.893003:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.893010:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.893018:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837904.893045:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3650:x1875732037039360:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837904.893057:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788837904.893087:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3649:1875732037039232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837904.893105:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037039360:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837904.893126:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9b800/0x57f6d4e926af0384 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af037d expref: 23 pid: 17192 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837904.893136:0:17216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875732037038976:0@lo:104: 00010000:00010000:2.0:1788837904.893145:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9a000/0x57f6d4e926af0376 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af036f expref: 22 pid: 17192 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837904.893153:0:17216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875732037039104:0@lo:104: 00010000:00010000:2.0:1788837904.893167:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.893175:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.893180:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837904.893186:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9a800/0x57f6d4e926af04c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837904.893268:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788837904.895957:0:19522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788837904.903631:0:19522:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788837904.903643:0:19522:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788837904.903681:0:19522:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788837904.903724:0:19522:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788837904.903745:0:19522:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788837904.903803:0:19522:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788837904.904616:0:19522:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788837904.904883:0:19522:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788837905.145756:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788837905.337090:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837905.337114:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037039488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837905.337176:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837905.337213:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037039488 00000100:00100000:0.0:1788837905.337219:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037039488 00000100:00100000:0.0:1788837905.337254:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788837905.337259:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037039488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837905.337300:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788837905.337335:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037039488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837905.337339:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788837905.337373:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037039488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837905.337795:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837905.337803:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037039616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837905.337826:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837905.337979:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037039616 00000100:00100000:1.0:1788837905.337983:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037039616 00000100:00100000:1.0:1788837905.338012:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788837905.338018:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037039616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788837905.338036:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788837905.338083:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037039616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837905.338099:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788837905.338128:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037039616:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788837905.723342:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788837905.761937:0:19588:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788837905.762137:0:19588:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788837906.744935:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788837906.746410:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788837906.746417:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ac444e800 from 10 10000000:01000000:3.0:1788837906.746422:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788837906.746482:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837906.746494:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837906.746504:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837906.746530:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037039744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837906.746618:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837906.746673:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c25973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837906.746748:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037039744 00000100:00100000:1.0:1788837906.746756:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037039744 00000100:00100000:1.0:1788837906.746843:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788837906.746853:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:17197:x1875732037039744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837906.746868:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837906.746883:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c8600/0x57f6d4e926af04d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af04cd expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837906.746908:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c8600/0x57f6d4e926af04d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af04cd expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837906.746918:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c8600/0x57f6d4e926af04d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af04cd expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837906.746928:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8600, rc 0) 00000100:00100000:1.0:1788837906.746974:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:17197:x1875732037039744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837906.746981:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788837906.747863:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037039744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837906.747884:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837906.747893:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837906.747956:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037039872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788837906.748000:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837906.748032:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c25973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837906.748423:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037039872 00000100:00100000:1.0:1788837906.748429:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037039872 00000100:00100000:1.0:1788837906.748474:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788837906.748482:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:17197:x1875732037039872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788837906.748500:0:17195:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788837906.748518:0:17195:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788837906.748521:0:17195:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788837906.748621:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:17197:x1875732037039872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837906.748629:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788837906.748715:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037039872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788837906.748799:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788837906.748807:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837906.748816:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afbea7c00/0x57f6d4e926af04cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af04d4 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837906.748832:0:17197:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788837906.748835:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889ac409c800 from 10 10000000:01000000:3.0:1788837906.748837:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788837906.748860:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837906.748868:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837906.748876:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837906.748890:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037040000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837906.748919:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837906.748938:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c25973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837906.749438:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037040000 00000100:00100000:1.0:1788837906.749445:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037040000 00000100:00100000:1.0:1788837906.749484:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788837906.749491:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:17197:x1875732037040000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837906.749501:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837906.749513:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c8a00/0x57f6d4e926af04e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af04db expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837906.749534:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c8a00/0x57f6d4e926af04e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af04db expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837906.749544:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c8a00/0x57f6d4e926af04e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af04db expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837906.749552:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8a00, rc 0) 00000100:00100000:1.0:1788837906.749597:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:17197:x1875732037040000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837906.749604:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788837906.749991:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037040000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837906.750006:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837906.750015:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837906.750064:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037040128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788837906.750100:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837906.750133:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c25973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837906.750770:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037040128 00000100:00100000:1.0:1788837906.750797:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037040128 00000100:00100000:1.0:1788837906.750837:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788837906.750845:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:17197:x1875732037040128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788837906.750862:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788837906.750878:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788837906.750881:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788837906.750978:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:17197:x1875732037040128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837906.750991:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788837906.751401:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037040128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788837906.751462:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788837906.751474:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837906.751483:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afbea6000/0x57f6d4e926af04db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af04e2 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837907.770343:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837908.795909:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837908.920959:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837908.936149:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037040256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837908.936243:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837908.936420:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037040256 00000100:00100000:2.0:1788837908.936428:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037040256 00000100:00100000:2.0:1788837908.936506:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837908.936517:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037040256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837908.936582:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788837908.936639:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037040256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837908.936647:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788837908.936699:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037040256:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788837908.936796:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837909.817003:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788837909.946018:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788837909.946024:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788837909.946028:0:37:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837909.946040:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8899c21e7000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837909.946059:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8899c3dd4a80 x1875732037040768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837909.946088:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788837909.946090:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788837909.946092:0:37:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837909.946095:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff889af8dbc000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788837909.946114:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889ad17af100 x1875732037041280/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837909.946185:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037040384:0@lo:400:kworker.0 00000100:00100000:3.0:1788837909.946259:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837909.946297:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037041024:0@lo:400:kworker.0 00000100:00100000:3.0:1788837909.946323:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837909.946341:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037041664:0@lo:400:kworker.0 00000100:00100000:3.0:1788837909.946390:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837909.946415:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788837909.946420:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037040512:0@lo:400:kworker.0 00000100:00100000:3.0:1788837909.947073:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837909.947854:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037041152:0@lo:400:kworker.0 00000100:00100000:3.0:1788837909.947899:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837909.947938:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037041792:0@lo:400:kworker.0 00000100:00100000:3.0:1788837909.949062:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837909.950280:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037040896:0@lo:400:kworker.0 00000100:00100000:3.0:1788837909.950331:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837909.950359:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037041536:0@lo:400:kworker.0 00000100:00100000:3.0:1788837909.950866:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837909.950891:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788837909.950898:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037040640:0@lo:400:kworker.0 00000100:00100000:3.0:1788837909.950919:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837909.952352:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037041664 00000100:00100000:3.0:1788837909.952666:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732037041408:0@lo:400:kworker.0 00000100:00100000:3.0:1788837909.952732:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837909.952745:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732037041920:0@lo:400:kworker.0 00000100:00100000:2.0:1788837909.953947:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037041792 00000100:00100000:2.0:1788837909.953956:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037041792 00000100:00100000:1.0:1788837909.954086:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037041664 00000100:00100000:2.0:1788837909.954211:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037040896 00000100:00100000:2.0:1788837909.954215:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037040896 00000100:00100000:2.0:1788837909.954227:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037041536 00000100:00100000:2.0:1788837909.954230:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037041536 00000100:00100000:2.0:1788837909.954240:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037041408 00000100:00100000:2.0:1788837909.954242:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037041408 00000100:00100000:2.0:1788837909.954256:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788837909.954265:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732037041792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837909.954343:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732037041792:12345-0@lo:400:kworker.0 Request processed in 80us (5285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837909.954350:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788837909.955555:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037041024 00000100:00100000:1.0:1788837909.955564:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037041024 00000100:00100000:1.0:1788837909.955600:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037040512 00000100:00100000:1.0:1788837909.955603:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037040512 00000100:00100000:1.0:1788837909.955619:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788837909.955627:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037041024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837909.955678:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037041024:12345-0@lo:400:kworker.0 Request processed in 51us (9353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837909.955685:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788837909.955700:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788837909.955706:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037040512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837909.955733:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037040512:12345-0@lo:400:kworker.0 Request processed in 27us (8661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837909.955738:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788837909.955845:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837909.955879:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037042048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837909.955909:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837909.956853:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037041920 00000100:00100000:2.0:1788837909.956862:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037041920 00000100:00100000:2.0:1788837909.956900:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788837909.956908:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037040896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837909.957659:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037041152 00000100:00100000:3.0:1788837909.957667:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037041152 00000100:00100000:1.0:1788837909.957852:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788837909.957864:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732037041536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837909.957932:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732037041536:12345-0@lo:400:kworker.0 Request processed in 71us (7065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837909.957940:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788837909.957956:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788837909.958551:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037040896:12345-0@lo:400:kworker.0 Request processed in 1641us (8216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837909.958559:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788837909.958577:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788837909.958585:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732037041920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837909.958635:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875732037041920:12345-0@lo:400:kworker.0 Request processed in 52us (2790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837909.958640:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788837909.958667:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837909.958682:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837909.958685:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837909.958736:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037040512:0@lo:400:kworker.0 00000100:00100000:1.0:1788837909.959511:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732037041408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837909.959570:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875732037041408:12345-0@lo:400:kworker.0 Request processed in 1608us (6838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837909.959589:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788837909.959623:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037040384 00000100:00100000:1.0:1788837909.959629:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037040384 00000100:00100000:1.0:1788837909.959665:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788837909.959670:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3650:x1875732037040384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837909.959718:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3650:x1875732037040384:12345-0@lo:400:kworker.0 Request processed in 48us (13459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837909.959725:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788837909.959895:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037040640 00000100:00100000:3.0:1788837909.959899:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037040640 00000100:00100000:3.0:1788837909.959941:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837909.959948:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037041152:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788837909.961261:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ad17af800 x1875732037041792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837909.961278:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037041792:0@lo:400:kworker.0 00000100:00100000:2.0:1788837909.961302:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037040384:0@lo:400:kworker.0 00000100:00100000:2.0:1788837909.961314:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037041024:0@lo:400:kworker.0 00000100:00100000:3.0:1788837909.961566:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037041152:12345-0@lo:400:kworker.0 Request processed in 1617us (13665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837909.961574:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788837909.961599:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788837909.961608:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037040640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837909.961639:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037040640:12345-0@lo:400:kworker.0 Request processed in 35us (10720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837909.961645:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837909.962649:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037040768:0@lo:8:kworker.0 00000100:00100000:1.0:1788837909.962694:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837909.963543:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037041280:0@lo:8:kworker.0 00000100:00100000:1.0:1788837909.963573:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837909.966569:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037040768 00000100:00100000:3.0:1788837909.966581:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037040768 00000100:00100000:3.0:1788837909.966625:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837909.966632:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1875732037040768:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788837909.966665:0:18708:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:3.0:1788837909.966695:0:18708:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x57f6d4e926af04e9 00002000:00100000:3.0:1788837909.966713:0:18708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8899c4402800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788837909.966717:0:18708:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788837909.966719:0:18708:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788837909.966911:0:18708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788837909.966952:0:18708:0:(import.c:65:import_set_state_nolock()) ffff8899c4406800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837909.967029:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875732037040768:12345-0@lo:8:kworker.0 Request processed in 396us (4334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837909.967036:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788837909.970416:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037042048 00000100:00100000:3.0:1788837909.970432:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037042048 00000100:00100000:3.0:1788837909.970536:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837909.970547:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037042048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788837909.970574:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788837909.970659:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037042048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (14748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837909.970666:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788837909.971164:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037041152:0@lo:400:kworker.0 00000100:00100000:2.0:1788837909.972466:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788837909.972476:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037041664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837909.972565:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037041664:12345-0@lo:400:kworker.0 Request processed in 91us (26174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837909.972572:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788837909.972616:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ad17ac380 x1875732037041664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837909.972629:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037041664:0@lo:400:kworker.0 00000100:00100000:2.0:1788837909.972669:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037042048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837909.972695:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037040640:0@lo:400:kworker.0 00010000:00080000:2.0:1788837909.972708:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ad17aca80 x1875732037041408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837909.972716:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875732037041408:0@lo:400:kworker.0 00010000:00080000:2.0:1788837909.972732:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ad17ad180 x1875732037041920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837909.972740:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875732037041920:0@lo:400:kworker.0 00010000:00080000:2.0:1788837909.972751:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3dd5f80 x1875732037040896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837909.972758:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037040896:0@lo:400:kworker.0 00010000:00080000:2.0:1788837909.972769:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ad17ac000 x1875732037041536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837909.972804:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037041536:0@lo:400:kworker.0 00000100:00080000:3.0:1788837909.973732:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788837909.974344:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3dd4a80 x1875732037040768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788837934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788837909.974362:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788837909.974371:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788837909.974377:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788837909.974380:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8899c21e7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788837909.974402:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788837909.974409:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875732037040768:0@lo:8:kworker.0 00000100:00100000:1.0:1788837909.974546:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037042176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837909.974593:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788837909.974638:0:17227:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1788837909.974661:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1875732037042304:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788837909.974690:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837909.984904:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac5f7f6c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788837909.984937:0:17226:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788837909.985344:0:17226:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 526856566407ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788837909.985352:0:17226:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788837909.985678:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037041280 00000100:00100000:3.0:1788837909.985688:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037041280 00000100:00100000:3.0:1788837909.985739:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037042304 00000100:00100000:3.0:1788837909.985742:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037042304 00000100:00100000:3.0:1788837909.985808:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788837909.985816:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1875732037041280:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788837909.985849:0:18708:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:3.0:1788837909.985880:0:18708:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x57f6d4e926af04f0 00002000:00100000:3.0:1788837909.985895:0:18708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8899c4407000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788837909.985899:0:18708:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788837909.985902:0:18708:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788837909.985940:0:18708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788837909.985981:0:18708:0:(import.c:65:import_set_state_nolock()) ffff8899c4406000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837909.986061:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875732037041280:12345-0@lo:8:kworker.0 Request processed in 244us (22486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837909.986069:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788837909.986086:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788837909.986093:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17227:x1875732037042304:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788837909.986320:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037042176 00000100:00100000:3.0:1788837909.986325:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037042176 00000100:00100000:3.0:1788837909.986358:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788837909.986379:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875732037042176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837909.986397:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788837909.986454:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875732037042176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (11860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837909.986461:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788837909.986507:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ad17af100 x1875732037041280/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788837934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837909.986534:0:3647:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788837909.986543:0:3647:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788837909.986548:0:3647:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788837909.986550:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889af8dbc000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788837909.986566:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788837909.986572:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875732037041280:0@lo:8:kworker.0 00010000:00080000:3.0:1788837909.986618:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c44cad80 x1875732037042176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837909.986633:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037042176:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788837909.986687:0:17944:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788837909.986720:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1875732037042560:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788837909.986754:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837909.986773:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af8f739c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837909.986812:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837909.986821:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037042432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837909.986843:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837909.986867:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037042560 00000100:00100000:3.0:1788837909.986877:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037042560 00000100:00100000:3.0:1788837909.986919:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788837909.986926:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17944:x1875732037042560:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788837909.986960:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037042432 00000100:00100000:3.0:1788837909.986964:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037042432 00000100:00100000:3.0:1788837909.986983:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788837909.986994:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875732037042432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788837909.987004:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788837909.987035:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875732037042432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837909.987041:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788837909.987067:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3d40380 x1875732037042432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788837925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837909.987079:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037042432:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788837909.987092:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788837909.989060:0:17943:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788837909.989155:0:17943:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 526860377740ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788837909.989163:0:17943:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788837909.992284:0:17933:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1788837909.992318:0:17180:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788837910.002897:0:18708:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788837910.002917:0:18708:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788837910.002923:0:18708:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:3.0:1788837910.007509:0:18709:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788837910.007530:0:18709:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788837910.007674:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17944:x1875732037042560:12345-0@lo:7:osp-pre-1-1.0 Request processed in 20744us (20915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837910.007684:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788837910.010488:0:17944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3d40000 x1875732037042560/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788837925 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837910.010508:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d40000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1875732037042560:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788837910.010534:0:17944:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788837910.010883:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1875732037042688:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788837910.010943:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837910.011285:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad01043c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837910.013729:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037042688 00000100:00100000:3.0:1788837910.013744:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037042688 00000100:00100000:3.0:1788837910.013834:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788837910.013844:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17944:x1875732037042688:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788837910.013875:0:19019:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788837910.013962:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17944:x1875732037042688:12345-0@lo:5:osp-pre-1-1.0 Request processed in 120us (3019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837910.013982:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788837910.014025:0:17944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3d9d500 x1875732037042688/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788837926 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837910.014040:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1875732037042688:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788837910.014052:0:17944:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788837910.014092:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d40380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1875732037042816:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788837910.014126:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837910.014147:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af8f73e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837910.014162:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037042816 00000100:00100000:3.0:1788837910.014166:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037042816 00000100:00100000:3.0:1788837910.014188:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788837910.014194:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17944:x1875732037042816:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788837910.014219:0:18709:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1788837910.035260:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.035273:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af04f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.035303:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.035308:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.035315:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af04f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.035333:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af04f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.035342:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af04f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.035349:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af04f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.035408:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788837910.035997:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.036004:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af04fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.036013:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.036017:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.036021:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af04fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.036030:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af04fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.036050:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af04fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.036057:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af04fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.042858:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837910.042870:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af04f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.042885:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837910.042890:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af04f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.042901:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af04f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.042925:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af04f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.042939:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af04f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.042961:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837910.042965:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af04fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.042972:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837910.042975:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af04fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.042983:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af04fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.042993:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af04fe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.043000:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837910.043002:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837910.043004:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837910.043809:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788837910.043818:0:18708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af04fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.043859:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788837910.044281:0:19523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788837910.044292:0:19523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788837910.044297:0:19523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788837910.046423:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17944:x1875732037042816:12345-0@lo:5:osp-pre-1-1.0 Request processed in 32219us (32287us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788837910.046435:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788837910.046556:0:17944:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788837910.046567:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d40380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1875732037042816:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788837910.046583:0:17944:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788837910.046630:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d40380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17944:1875732037042944:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788837910.046679:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837910.046704:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff889af8f73e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837910.046721:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037042944 00000100:00100000:3.0:1788837910.046737:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037042944 00000100:00100000:3.0:1788837910.046798:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788837910.046807:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17944:x1875732037042944:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788837910.046854:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17944:x1875732037042944:12345-0@lo:900:osp-pre-1-1.0 Request processed in 48us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837910.046861:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788837910.046891:0:17944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3d40380 x1875732037042944/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788837926 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837910.046902:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d40380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17944:1875732037042944:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1788837910.054706:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837910.059323:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af0505 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.059351:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1788837910.059355:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837910.059363:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af0505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.059381:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af0505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.059393:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af0505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.059414:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af0505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.059436:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788837910.059451:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837910.059457:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af0505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.059465:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837910.059469:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af0505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.059479:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af0505 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.059496:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af0505 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.059504:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af0505 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.059532:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837910.059535:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837910.059536:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788837910.060197:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837910.060212:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af050c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060221:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1788837910.060225:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837910.060229:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af050c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060239:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af050c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060248:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af050c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060256:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af050c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060280:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788837910.060534:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837910.060540:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af0513 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060549:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1788837910.060552:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837910.060556:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af0513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060564:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af0513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060577:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af0513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060584:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af0513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060600:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788837910.060839:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837910.060845:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af051a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060853:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1788837910.060856:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837910.060860:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af051a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060868:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af051a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060875:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af051a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060882:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af051a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060905:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788837910.060913:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788837910.060918:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af050c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060925:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837910.060929:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af050c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060938:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af050c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060950:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af050c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060956:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af050c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060971:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837910.060974:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af0513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.060980:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837910.060983:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af0513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.061001:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af0513 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.061012:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af0513 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.061018:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af0513 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.061030:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837910.061033:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af051a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.061039:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837910.061042:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af051a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.061050:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af051a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.061059:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af051a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.061066:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af051a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.061087:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837910.061088:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837910.061090:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837910.061316:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788837910.061390:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837910.061396:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069c94798/0x57f6d4e926af0521 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.061405:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1788837910.061407:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837910.061412:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069c94798/0x57f6d4e926af0521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.061420:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069c94798/0x57f6d4e926af0521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.061427:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069c94798/0x57f6d4e926af0521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.061435:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069c94798/0x57f6d4e926af0521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.061487:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837910.065358:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837910.065376:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069c94798/0x57f6d4e926af0521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.065390:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837910.065395:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069c94798/0x57f6d4e926af0521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.065408:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069c94798/0x57f6d4e926af0521 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.065432:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069c94798/0x57f6d4e926af0521 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.065439:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069c94798/0x57f6d4e926af0521 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.065461:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837910.065463:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837910.065465:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837910.066909:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837910.069684:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837910.069697:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0528 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.069714:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=526s v=(0 0) 00010000:00010000:1.0:1788837910.069718:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837910.069737:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.069751:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.069761:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.069769:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.069816:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837910.070258:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837910.070266:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.070275:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837910.070279:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.070288:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0528 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.070317:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0528 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.070324:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1a26c74/0x57f6d4e926af0528 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.070341:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837910.070343:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837910.070344:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837910.070575:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.070581:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af052f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.070590:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.070593:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.070598:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af052f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.070606:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af052f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.070613:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af052f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.070620:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af052f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.070652:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837910.070973:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837910.070979:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af052f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.070987:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.070997:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af052f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.071004:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af052f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.071016:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af052f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.071022:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063680de5/0x57f6d4e926af052f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.071038:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.071040:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.071041:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837910.071118:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.071123:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af0536 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071131:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.071134:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.071139:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af0536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071148:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af0536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071156:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af0536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071164:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af0536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071185:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837910.071417:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837910.071423:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af0536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.071431:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.071434:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af0536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.071442:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af0536 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.071453:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af0536 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.071467:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2169d6e/0x57f6d4e926af0536 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.071480:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.071482:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.071483:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837910.071566:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.071572:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000a3250f/0x57f6d4e926af053d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071580:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.071588:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.071593:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000a3250f/0x57f6d4e926af053d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071603:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000a3250f/0x57f6d4e926af053d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071610:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000a3250f/0x57f6d4e926af053d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071617:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000a3250f/0x57f6d4e926af053d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071648:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788837910.071934:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.071939:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b28e0f91/0x57f6d4e926af0544 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071948:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.071951:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.071956:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b28e0f91/0x57f6d4e926af0544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071964:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b28e0f91/0x57f6d4e926af0544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071972:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b28e0f91/0x57f6d4e926af0544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071985:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b28e0f91/0x57f6d4e926af0544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.071996:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788837910.072177:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837910.072183:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000a3250f/0x57f6d4e926af053d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.072191:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.072195:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000a3250f/0x57f6d4e926af053d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.072204:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000a3250f/0x57f6d4e926af053d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.072215:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000a3250f/0x57f6d4e926af053d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.072222:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000a3250f/0x57f6d4e926af053d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.072237:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837910.072241:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b28e0f91/0x57f6d4e926af0544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.072255:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b800 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.072258:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b28e0f91/0x57f6d4e926af0544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.072265:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b28e0f91/0x57f6d4e926af0544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.072276:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b28e0f91/0x57f6d4e926af0544 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.072283:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b28e0f91/0x57f6d4e926af0544 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.072296:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.072297:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.072299:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.072305:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837910.072441:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.072448:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffeb3bae/0x57f6d4e926af054b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.072456:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.072459:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.072463:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffeb3bae/0x57f6d4e926af054b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.072471:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffeb3bae/0x57f6d4e926af054b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.072479:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffeb3bae/0x57f6d4e926af054b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.072486:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffeb3bae/0x57f6d4e926af054b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.072506:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837910.077502:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837910.077529:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffeb3bae/0x57f6d4e926af054b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.077545:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9a200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.077550:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffeb3bae/0x57f6d4e926af054b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.077576:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffeb3bae/0x57f6d4e926af054b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.077599:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffeb3bae/0x57f6d4e926af054b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.077607:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffeb3bae/0x57f6d4e926af054b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.077632:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.077634:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.077636:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837910.080943:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.080958:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d696b65d/0x57f6d4e926af0552 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.080982:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.080987:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.080993:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d696b65d/0x57f6d4e926af0552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.081007:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d696b65d/0x57f6d4e926af0552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.081018:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d696b65d/0x57f6d4e926af0552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.081025:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d696b65d/0x57f6d4e926af0552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.081047:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788837910.084211:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.084225:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f7a4e2a/0x57f6d4e926af0559 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.084243:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.084248:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.084254:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f7a4e2a/0x57f6d4e926af0559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.084269:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f7a4e2a/0x57f6d4e926af0559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.084290:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f7a4e2a/0x57f6d4e926af0559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.084298:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f7a4e2a/0x57f6d4e926af0559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.084330:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788837910.084808:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837910.084817:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d696b65d/0x57f6d4e926af0552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.084826:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16c00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837910.084831:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d696b65d/0x57f6d4e926af0552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.084851:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d696b65d/0x57f6d4e926af0552 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.084869:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d696b65d/0x57f6d4e926af0552 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.084876:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d696b65d/0x57f6d4e926af0552 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.084891:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837910.084894:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f7a4e2a/0x57f6d4e926af0559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.084900:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837910.084903:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f7a4e2a/0x57f6d4e926af0559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.084909:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f7a4e2a/0x57f6d4e926af0559 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.084917:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f7a4e2a/0x57f6d4e926af0559 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.084923:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f7a4e2a/0x57f6d4e926af0559 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.084942:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837910.084943:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837910.084946:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837910.085871:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.085881:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003048600c/0x57f6d4e926af0560 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.085896:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.085900:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.085905:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003048600c/0x57f6d4e926af0560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.085917:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003048600c/0x57f6d4e926af0560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.085926:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003048600c/0x57f6d4e926af0560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.085933:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003048600c/0x57f6d4e926af0560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.085965:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837910.086311:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837910.086318:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003048600c/0x57f6d4e926af0560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.086327:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16e00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837910.086331:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003048600c/0x57f6d4e926af0560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.086339:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003048600c/0x57f6d4e926af0560 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.086355:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003048600c/0x57f6d4e926af0560 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.086361:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003048600c/0x57f6d4e926af0560 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.086378:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837910.086380:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837910.086382:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837910.086466:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.086472:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009466ec49/0x57f6d4e926af0567 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.086481:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.086484:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.086488:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009466ec49/0x57f6d4e926af0567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.086497:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009466ec49/0x57f6d4e926af0567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.086503:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009466ec49/0x57f6d4e926af0567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.086512:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009466ec49/0x57f6d4e926af0567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.086540:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837910.086802:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837910.086809:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009466ec49/0x57f6d4e926af0567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.086817:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.086820:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009466ec49/0x57f6d4e926af0567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.086828:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009466ec49/0x57f6d4e926af0567 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.086839:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009466ec49/0x57f6d4e926af0567 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.086859:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009466ec49/0x57f6d4e926af0567 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.086873:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.086875:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.086876:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837910.087457:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.087465:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8cc0ab9/0x57f6d4e926af056e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.087475:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.087485:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.087490:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8cc0ab9/0x57f6d4e926af056e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.087501:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8cc0ab9/0x57f6d4e926af056e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.087509:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8cc0ab9/0x57f6d4e926af056e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.087539:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8cc0ab9/0x57f6d4e926af056e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.087559:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837910.087849:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837910.087855:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8cc0ab9/0x57f6d4e926af056e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.087876:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837910.087881:0:17953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8cc0ab9/0x57f6d4e926af056e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.087890:0:17953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8cc0ab9/0x57f6d4e926af056e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.087903:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8cc0ab9/0x57f6d4e926af056e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.087910:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8cc0ab9/0x57f6d4e926af056e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.087925:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837910.087927:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837910.087928:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.087981:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837910.089881:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.089893:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775235f0/0x57f6d4e926af0575 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.089909:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.089913:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.089919:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000775235f0/0x57f6d4e926af0575 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.089932:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000775235f0/0x57f6d4e926af0575 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.089941:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000775235f0/0x57f6d4e926af0575 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.089957:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000775235f0/0x57f6d4e926af0575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.089973:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788837910.090452:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.090458:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4b23b2f/0x57f6d4e926af057c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.090467:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.090470:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.090474:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b23b2f/0x57f6d4e926af057c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.090483:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4b23b2f/0x57f6d4e926af057c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.090490:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4b23b2f/0x57f6d4e926af057c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.090498:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b23b2f/0x57f6d4e926af057c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.090528:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788837910.090842:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837910.090850:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000775235f0/0x57f6d4e926af0575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.090858:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.090863:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000775235f0/0x57f6d4e926af0575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.090872:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000775235f0/0x57f6d4e926af0575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.090887:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000775235f0/0x57f6d4e926af0575 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.090894:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000775235f0/0x57f6d4e926af0575 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.090910:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837910.090913:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4b23b2f/0x57f6d4e926af057c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.090926:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.090929:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4b23b2f/0x57f6d4e926af057c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.090937:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4b23b2f/0x57f6d4e926af057c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.090948:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4b23b2f/0x57f6d4e926af057c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.090955:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4b23b2f/0x57f6d4e926af057c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.091160:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.091162:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.091164:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837910.091258:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.091264:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003acf59de/0x57f6d4e926af0583 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.091278:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.091281:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.091285:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003acf59de/0x57f6d4e926af0583 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.091293:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003acf59de/0x57f6d4e926af0583 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.091300:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003acf59de/0x57f6d4e926af0583 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.091308:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003acf59de/0x57f6d4e926af0583 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.091360:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788837910.093233:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837910.093246:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3090eee/0x57f6d4e926af058a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.093263:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=526s v=(0 0) 00010000:00010000:0.0:1788837910.093267:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837910.093273:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3090eee/0x57f6d4e926af058a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.093285:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3090eee/0x57f6d4e926af058a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.093308:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3090eee/0x57f6d4e926af058a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837910.093315:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3090eee/0x57f6d4e926af058a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.093374:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837910.093382:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003acf59de/0x57f6d4e926af0583 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.093389:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.093394:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003acf59de/0x57f6d4e926af0583 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.093403:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003acf59de/0x57f6d4e926af0583 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.093427:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003acf59de/0x57f6d4e926af0583 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.093435:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003acf59de/0x57f6d4e926af0583 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.093452:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837910.093456:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3090eee/0x57f6d4e926af058a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.093463:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16000 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.093466:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3090eee/0x57f6d4e926af058a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.093472:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3090eee/0x57f6d4e926af058a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.093481:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3090eee/0x57f6d4e926af058a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.093489:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.093491:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.093493:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837910.093546:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837910.093606:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788837910.093611:0:18708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3090eee/0x57f6d4e926af058a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788837910.099169:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837910.099185:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0591 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.099204:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=526s v=(0 0) 00010000:00010000:2.0:1788837910.099208:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837910.099215:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0591 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.099245:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0591 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.099255:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0591 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837910.099264:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0591 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.102187:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837910.102203:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0591 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.102230:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.102235:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0591 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.102247:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0591 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.102267:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0591 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.102275:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.102277:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.102279:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837910.105235:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788837910.105252:0:18708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e64a933a/0x57f6d4e926af0591 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837910.109106:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837910.109119:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af0598 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.109147:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1788837910.109151:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837910.109157:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af0598 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.109171:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af0598 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.109181:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af0598 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.109188:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af0598 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.109212:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788837910.109616:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837910.109622:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af059f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.109630:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1788837910.109632:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837910.109636:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af059f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.109645:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af059f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.109663:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af059f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.109670:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af059f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.109690:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788837910.110021:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837910.110026:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af05a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110036:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1788837910.110039:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837910.110043:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af05a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110052:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af05a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110060:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af05a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110068:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af05a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110088:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788837910.110321:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837910.110327:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af05ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110335:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1788837910.110338:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837910.110342:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af05ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110352:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af05ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110361:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af05ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110369:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af05ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110377:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788837910.110617:0:18708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837910.110623:0:18708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049eb0ea6/0x57f6d4e926af05b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110631:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1788837910.110639:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837910.110644:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049eb0ea6/0x57f6d4e926af05b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110653:0:18708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049eb0ea6/0x57f6d4e926af05b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110660:0:18708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049eb0ea6/0x57f6d4e926af05b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110666:0:18708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049eb0ea6/0x57f6d4e926af05b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837910.110673:0:18708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:3.0:1788837910.110702:0:18708:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1788837910.111912:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17227:x1875732037042304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 125810us (137211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837910.111925:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788837910.111992:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c44c8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1875732037042304:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788837910.112008:0:17227:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788837910.112053:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d40380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1875732037043072:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788837910.112085:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837910.112108:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837910.112125:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037043072 00000100:00100000:3.0:1788837910.112131:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037043072 00000100:00100000:3.0:1788837910.112172:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788837910.112181:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17227:x1875732037043072:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788837910.112221:0:19019:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:1.0:1788837910.112526:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788837910.112536:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af0598 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112548:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7600 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.112553:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af0598 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112563:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af0598 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112582:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af0598 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112595:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3314c5f/0x57f6d4e926af0598 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112615:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788837910.112619:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af059f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112625:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.112628:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af059f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112635:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af059f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112643:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af059f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112649:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc4ea2b5/0x57f6d4e926af059f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112658:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788837910.112661:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af05a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112667:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.112673:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af05a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112681:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af05a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112689:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af05a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112695:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a797c47/0x57f6d4e926af05a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112704:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837910.112708:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af05ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112713:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.112715:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af05ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112731:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af05ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112739:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af05ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112746:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7318eee/0x57f6d4e926af05ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112765:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837910.112768:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049eb0ea6/0x57f6d4e926af05b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112791:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:1.0:1788837910.112795:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049eb0ea6/0x57f6d4e926af05b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112803:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049eb0ea6/0x57f6d4e926af05b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112813:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049eb0ea6/0x57f6d4e926af05b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112820:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049eb0ea6/0x57f6d4e926af05b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837910.112833:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.112834:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.112836:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837910.112854:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837910.112970:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837910.117068:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17227:x1875732037043072:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4880us (4973us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788837910.117082:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788837910.117181:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d40380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1875732037043072:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788837910.117197:0:17227:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:2.0:1788837910.458896:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037043200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837910.458965:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837910.459031:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037043200 00000100:00100000:2.0:1788837910.459038:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037043200 00000100:00100000:2.0:1788837910.459087:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788837910.459096:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037043200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788837910.459130:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788837910.459175:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037043200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837910.459182:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788837910.459227:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037043200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837910.460881:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837910.460897:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037043328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837910.460950:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837910.460991:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037043328 00000100:00100000:2.0:1788837910.460997:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037043328 00000100:00100000:2.0:1788837910.461032:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788837910.461040:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037043328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788837910.461065:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788837910.461101:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037043328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837910.461108:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788837910.461144:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037043328:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788837910.842219:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837911.418671:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1788837911.727140:0:19878:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788837911.865260:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788837912.485026:0:19930:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788837912.485266:0:19930:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788837912.899018:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788837913.410271:0:19980:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788837913.410516:0:19980:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788837913.729161:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837913.729256:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012844288 00000100:00100000:0.0:1788837913.729268:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012844288 00000100:00100000:0.0:1788837913.729325:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 116 00000100:00100000:0.0:1788837913.729334:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2392:x1875732012844288:12345-192.168.201.3@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788837913.729373:0:17194:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7253ef40-cd6d-4a26-9386-e23758a56a4e@192.168.201.3@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:0.0:1788837913.729491:0:17194:0:(genops.c:1385:class_connect()) connect: client 7253ef40-cd6d-4a26-9386-e23758a56a4e, cookie 0x57f6d4e926af05bb 00000100:00080000:0.0:1788837913.729642:0:17194:0:(import.c:65:import_set_state_nolock()) ffff8899c36a3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837913.730866:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+5:2392:x1875732012844288:12345-192.168.201.3@tcp:250:mount.lustre.0 Request processed in 1526us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837913.730891:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 116 00000100:00100000:0.0:1788837913.755609:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837913.755710:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012844416 00000100:00100000:1.0:1788837913.755720:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012844416 00000100:00100000:1.0:1788837913.755830:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 117 00000100:00100000:1.0:1788837913.755841:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+5:14882:x1875732012844416:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788837913.755859:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837913.755879:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926af05c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003edfc expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.755928:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926af05c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edfc expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.755941:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c9a00/0x57f6d4e926af05c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003edfc expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.755951:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9a00, rc 0) 00000100:00100000:1.0:1788837913.756020:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+6:14882:x1875732012844416:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 181us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837913.756027:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 117 00000100:00100000:3.0:1788837913.764253:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837913.764927:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012844544 00000100:00100000:0.0:1788837913.764940:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012844544 00000100:00100000:0.0:1788837913.765011:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 118 00000100:00100000:0.0:1788837913.765021:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+6:14882:x1875732012844544:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788837913.765175:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+6:14882:x1875732012844544:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 155us (934us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788837913.765182:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 118 00000100:00100000:0.0:1788837913.773912:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837913.774158:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012844672 00000100:00100000:3.0:1788837913.774169:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012844672 00000100:00100000:3.0:1788837913.774225:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 119 00000100:00100000:3.0:1788837913.774235:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+6:14882:x1875732012844672:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788837913.774252:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837913.774271:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afbea6400/0x57f6d4e926af05c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003ee03 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.774301:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afbea6400/0x57f6d4e926af05c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee03 expref: 7 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.774312:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afbea6400/0x57f6d4e926af05c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee03 expref: 7 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.774322:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea6400, rc 0) 00000100:00100000:3.0:1788837913.774384:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+7:14882:x1875732012844672:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 150us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837913.774398:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 119 00000100:00100000:2.0:1788837913.788495:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837913.788804:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012844800 00000100:00100000:1.0:1788837913.788815:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012844800 00000100:00100000:1.0:1788837913.788874:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 120 00000100:00100000:1.0:1788837913.788892:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+7:14882:x1875732012844800:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788837913.789068:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+8:14882:x1875732012844800:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 185us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837913.789077:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 120 00000100:00100000:1.0:1788837913.798839:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837913.799872:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012844928 00000100:00100000:0.0:1788837913.799895:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012844928 00000100:00100000:0.0:1788837913.800069:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 121 00000100:00100000:0.0:1788837913.800081:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+8:14882:x1875732012844928:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788837913.800286:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+8:14882:x1875732012844928:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 208us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837913.800294:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 121 00000100:00100000:2.0:1788837913.812857:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837913.815293:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012845056 00000100:00100000:3.0:1788837913.815309:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012845056 00000100:00100000:3.0:1788837913.815401:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:3.0:1788837913.815411:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+8:14901:x1875732012845056:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837913.815586:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+8:14901:x1875732012845056:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 176us (2936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837913.815601:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:2.0:1788837913.851855:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837913.852152:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012845184 00000100:00100000:1.0:1788837913.852164:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012845184 00000100:00100000:1.0:1788837913.852221:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 123 00000100:00100000:1.0:1788837913.852233:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+8:14901:x1875732012845184:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788837913.852545:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+8:14901:x1875732012845184:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 311us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837913.852554:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 123 00000100:00100000:1.0:1788837913.873336:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837913.873605:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012845312 00000100:00100000:0.0:1788837913.873615:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012845312 00000100:00100000:0.0:1788837913.873676:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 124 00000100:00100000:0.0:1788837913.873685:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+8:14901:x1875732012845312:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788837913.873885:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+8:14901:x1875732012845312:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 200us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837913.873893:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 124 00000100:00100000:2.0:1788837913.879335:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837913.879770:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012845440 00000100:00100000:1.0:1788837913.879826:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012845440 00000100:00100000:1.0:1788837913.879878:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 125 00000100:00100000:1.0:1788837913.879887:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+8:14882:x1875732012845440:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788837913.879904:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837913.879934:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c9e00/0x57f6d4e926af05d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003ee34 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.879965:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c9e00/0x57f6d4e926af05d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee34 expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.879977:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c9e00/0x57f6d4e926af05d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee34 expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.879986:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9e00, rc 0) 00000100:00100000:1.0:1788837913.880048:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+9:14882:x1875732012845440:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 161us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837913.880055:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 125 00000100:00100000:2.0:1788837913.894651:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837913.894856:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012845568 00000100:00100000:3.0:1788837913.894867:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012845568 00000100:00100000:3.0:1788837913.894931:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 126 00000100:00100000:3.0:1788837913.894942:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+9:14882:x1875732012845568:12345-192.168.201.3@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788837913.894970:0:17195:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788837913.894994:0:17195:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788837913.894998:0:17195:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788837913.895002:0:17195:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788837913.895005:0:17195:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788837913.895007:0:17195:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788837913.897520:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+9:14882:x1875732012845568:12345-192.168.201.3@tcp:256:mount.lustre.0 Request processed in 2570us (2869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837913.897534:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 126 00000100:00100000:2.0:1788837913.903582:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837913.903890:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012845696 00000100:00100000:0.0:1788837913.903902:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012845696 00000100:00100000:0.0:1788837913.903974:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 127 00000100:00100000:0.0:1788837913.903986:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889af6fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+9:14882:x1875732012845696:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788837913.904005:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837913.904024:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889ac2b16a00/0x57f6d4e926af05d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003ee3b expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.904052:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889ac2b16a00/0x57f6d4e926af05d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee3b expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.904063:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889ac2b16a00/0x57f6d4e926af05d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee3b expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.904071:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16a00, rc 0) 00000100:00100000:0.0:1788837913.904133:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889af6fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+10:14882:x1875732012845696:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 149us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837913.904140:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 127 00010000:00010000:1.0:1788837913.913421:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837913.915426:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837913.918363:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012845824 00000100:00100000:3.0:1788837913.918381:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012845824 00000100:00100000:0.0:1788837913.922797:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 128 00000100:00100000:0.0:1788837913.922820:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+10:14882:x1875732012845824:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788837913.923095:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+10:14882:x1875732012845824:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 285us (7678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837913.923103:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 128 00000100:00100000:2.0:1788837913.930068:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837913.933763:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012845952 00000100:00100000:3.0:1788837913.933821:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012845952 00000100:00100000:0.0:1788837913.938163:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 129 00000100:00100000:0.0:1788837913.938179:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+10:14882:x1875732012845952:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788837913.938347:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+10:14882:x1875732012845952:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 171us (8289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837913.938362:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 129 00000100:00100000:1.0:1788837913.947515:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837913.950049:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012846080 00000100:00100000:0.0:1788837913.950067:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012846080 00000100:00100000:0.0:1788837913.950136:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:0.0:1788837913.950147:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+10:14906:x1875732012846080:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788837913.950319:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+10:14906:x1875732012846080:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 173us (2814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837913.950327:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:1.0:1788837913.966464:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837913.968838:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012846208 00000100:00100000:0.0:1788837913.968854:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012846208 00000100:00100000:0.0:1788837913.968936:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 131 00000100:00100000:0.0:1788837913.968946:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+10:14906:x1875732012846208:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788837913.969106:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+10:14906:x1875732012846208:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 160us (2659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837913.969114:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 131 00000100:00100000:0.0:1788837913.987194:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837913.987549:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012846336 00000100:00100000:2.0:1788837913.987560:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012846336 00000100:00100000:2.0:1788837913.987614:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:2.0:1788837913.987623:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875732012846336:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788837913.987669:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 067bdd78-c556-4265-9b97-e4112a37245c@192.168.201.3@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:2.0:1788837913.987754:0:17200:0:(genops.c:1385:class_connect()) connect: client 067bdd78-c556-4265-9b97-e4112a37245c, cookie 0x57f6d4e926af05de 00000004:00100000:2.0:1788837913.987823:0:17200:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788837913.988284:0:17200:0:(import.c:65:import_set_state_nolock()) ffff889ac84b8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837913.988401:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+6:2392:x1875732012846336:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 777us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837913.988410:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:1.0:1788837913.999223:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837913.999327:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012846592 00000100:00100000:2.0:1788837913.999337:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012846592 00000100:00100000:2.0:1788837913.999392:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:2.0:1788837913.999400:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875732012846592:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788837913.999431:0:17201:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 067bdd78-c556-4265-9b97-e4112a37245c@192.168.201.3@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:2.0:1788837913.999513:0:17201:0:(genops.c:1385:class_connect()) connect: client 067bdd78-c556-4265-9b97-e4112a37245c, cookie 0x57f6d4e926af05e5 00000004:00100000:2.0:1788837913.999730:0:17201:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788837914.008390:0:17201:0:(import.c:65:import_set_state_nolock()) ffff889aded3e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837914.020849:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+6:2392:x1875732012846592:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 21435us (21623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837914.020864:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:0.0:1788837914.027749:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837914.027863:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837914.032429:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012846848 00000100:00100000:1.0:1788837914.032453:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012846848 00000100:00100000:1.0:1788837914.032541:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012846464 00000100:00100000:1.0:1788837914.032544:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012846464 00000100:00100000:1.0:1788837914.032568:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:1.0:1788837914.032578:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+7:14882:x1875732012846848:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788837914.032618:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788837914.036989:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+7:14882:x1875732012846848:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 4298us (9135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837914.037004:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:1.0:1788837914.037159:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:1.0:1788837914.037171:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+6:0:x1875732012846464:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788837914.037201:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788837914.037239:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+6:0:x1875732012846464:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 72us (9375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837914.037246:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00080000:0.0:1788837914.037757:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837914.044008:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037043456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837914.044088:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837914.044630:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037043456 00000100:00100000:1.0:1788837914.044639:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037043456 00000100:00100000:1.0:1788837914.044724:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837914.044733:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037043456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837914.044764:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788837914.044837:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037043456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837914.044845:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788837914.044970:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837914.045008:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037043456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837914.045319:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837914.045359:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837914.046587:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012846720 00000100:00100000:3.0:1788837914.046598:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012846720 00000100:00080000:0.0:1788837914.046685:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837914.049427:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012846976 00000100:00100000:2.0:1788837914.049443:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012846976 00000100:00100000:2.0:1788837914.049678:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:2.0:1788837914.049691:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+6:0:x1875732012846720:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788837914.049731:0:17202:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788837914.049839:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+6:0:x1875732012846720:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 151us (4521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837914.049846:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:2.0:1788837914.049892:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:2.0:1788837914.049899:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+6:14882:x1875732012846976:12345-192.168.201.3@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788837914.049932:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+6:14882:x1875732012846976:12345-192.168.201.3@tcp:40:mount.lustre.0 Request processed in 34us (4574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837914.049938:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:1.0:1788837914.054033:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837914.054081:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837914.054103:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837914.054356:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012847104 00000100:00100000:3.0:1788837914.054366:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012847104 00000100:00100000:3.0:1788837914.054405:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012847232 00000100:00100000:3.0:1788837914.054408:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012847232 00000100:00100000:3.0:1788837914.054443:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:3.0:1788837914.054479:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875732012847104:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788837914.054512:0:18709:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 067bdd78-c556-4265-9b97-e4112a37245c@192.168.201.3@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:3.0:1788837914.054676:0:18709:0:(genops.c:1385:class_connect()) connect: client 067bdd78-c556-4265-9b97-e4112a37245c, cookie 0x57f6d4e926af05ec 00002000:00100000:3.0:1788837914.054689:0:18709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 067bdd78-c556-4265-9b97-e4112a37245c/ffff889aded38000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788837914.054699:0:18709:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788837914.054915:0:18709:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788837914.054946:0:18709:0:(import.c:65:import_set_state_nolock()) ffff889aded3e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837914.055030:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067bdd78-c556-4265-9b97-e4112a37245c+6:2392:x1875732012847104:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 550us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837914.055037:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:3.0:1788837914.055055:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:3.0:1788837914.055060:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875732012847232:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788837914.055077:0:18709:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 067bdd78-c556-4265-9b97-e4112a37245c@192.168.201.3@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:3.0:1788837914.055103:0:18709:0:(genops.c:1385:class_connect()) connect: client 067bdd78-c556-4265-9b97-e4112a37245c, cookie 0x57f6d4e926af05f3 00002000:00100000:3.0:1788837914.055109:0:18709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 067bdd78-c556-4265-9b97-e4112a37245c/ffff889ac6be7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788837914.055121:0:18709:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788837914.055265:0:18709:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788837914.055282:0:18709:0:(import.c:65:import_set_state_nolock()) ffff889ac6be7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837914.055306:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067bdd78-c556-4265-9b97-e4112a37245c+6:2392:x1875732012847232:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 244us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837914.055313:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:3.0:1788837914.055335:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012847360 00000100:00100000:3.0:1788837914.055339:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012847360 00000100:00100000:3.0:1788837914.055377:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:3.0:1788837914.055383:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:067bdd78-c556-4265-9b97-e4112a37245c+6:14882:x1875732012847360:12345-192.168.201.3@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788837914.055416:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:067bdd78-c556-4265-9b97-e4112a37245c+6:14882:x1875732012847360:12345-192.168.201.3@tcp:900:mount.lustre.0 Request processed in 33us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837914.055422:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:2.0:1788837914.059398:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837914.067634:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012847488 00000100:00100000:2.0:1788837914.067712:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012847488 00000100:00100000:2.0:1788837914.067860:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:2.0:1788837914.067871:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067bdd78-c556-4265-9b97-e4112a37245c+6:14882:x1875732012847488:12345-192.168.201.3@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788837914.071987:0:17203:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4018us 00000004:00200000:1.0:1788837914.109692:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788837914.109866:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067bdd78-c556-4265-9b97-e4112a37245c+6:14882:x1875732012847488:12345-192.168.201.3@tcp:33:mount.lustre.0 Request processed in 41990us (50472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837914.109889:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:2.0:1788837914.369133:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837914.369554:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012847616 00000100:00100000:1.0:1788837914.369565:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012847616 00000100:00100000:1.0:1788837914.369638:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:1.0:1788837914.369853:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+6:14929:x1875732012847616:12345-192.168.201.3@tcp:101:mkdir.0 00010000:00010000:1.0:1788837914.369883:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837914.369910:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926af05fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ee6c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837914.369975:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0601 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837914.369988:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837914.370002:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837914.370046:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788837914.370049:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837914.370081:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837914.370105:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c8000/0x57f6d4e926af05fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee6c expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837914.370139:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0601 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee6c expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837914.370148:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1ef00) 00010000:00010000:1.0:1788837914.370151:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837914.370154:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c9800, rc 0) 00000100:00100000:1.0:1788837914.370219:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+7:14929:x1875732012847616:12345-192.168.201.3@tcp:101:mkdir.0 Request processed in 572us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837914.370225:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00010000:00010000:3.0:1788837914.937011:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837915.065141:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037043584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837915.065209:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837915.065425:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037043584 00000100:00100000:3.0:1788837915.065444:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037043584 00000100:00100000:3.0:1788837915.065509:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837915.065519:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037043584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788837915.065542:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788837915.065590:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037043584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.065597:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788837915.065697:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837915.065733:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037043584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837915.066124:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037043712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837915.066156:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837915.066308:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037043712 00000100:00100000:1.0:1788837915.066313:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037043712 00000100:00100000:1.0:1788837915.066352:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788837915.066359:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732037043712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837915.066372:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788837915.066415:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875732037043712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837915.066422:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788837915.066502:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037043712:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788837915.066554:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837915.067054:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037043968:0@lo:400:kworker.0 00000100:00100000:3.0:1788837915.067089:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837915.067118:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037044480:0@lo:400:kworker.0 00000100:00100000:3.0:1788837915.067140:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837915.067157:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037044992:0@lo:400:kworker.0 00000100:00100000:3.0:1788837915.067173:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837915.067186:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788837915.067189:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037044096:0@lo:400:kworker.0 00000100:00100000:3.0:1788837915.067215:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837915.067225:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037044608:0@lo:400:kworker.0 00000100:00100000:3.0:1788837915.067236:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837915.067244:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732037045120:0@lo:400:kworker.0 00000100:00100000:3.0:1788837915.067253:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837915.067269:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037043968 00000100:00100000:3.0:1788837915.067272:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037043968 00000100:00100000:3.0:1788837915.067294:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788837915.067298:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037043968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837915.067326:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037043968:12345-0@lo:400:kworker.0 Request processed in 27us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.067330:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788837915.067342:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037044480 00000100:00100000:3.0:1788837915.067344:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037044480 00000100:00100000:3.0:1788837915.067370:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037044096 00000100:00100000:3.0:1788837915.067413:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037044096 00000100:00100000:3.0:1788837915.067439:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837915.067447:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037044480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837915.067481:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037044480:12345-0@lo:400:kworker.0 Request processed in 36us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.067487:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837915.067498:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788837915.067503:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037044096:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788837915.067520:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837915.067528:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037044096:12345-0@lo:400:kworker.0 Request processed in 25us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.067533:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788837915.067537:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037044992 00000100:00100000:0.0:1788837915.067540:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037044992 00000100:00080000:0.0:1788837915.067553:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837915.067557:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037044608 00000100:00100000:3.0:1788837915.067561:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037044608 00000100:00100000:3.0:1788837915.067573:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037045120 00000100:00100000:3.0:1788837915.067575:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037045120 00000100:00100000:0.0:1788837915.067577:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788837915.067583:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732037044992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837915.067599:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788837915.067604:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837915.067605:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037044608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837915.067633:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875732037044608:12345-0@lo:400:kworker.0 Request processed in 28us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837915.067633:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732037044992:12345-0@lo:400:kworker.0 Request processed in 50us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.067639:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788837915.067826:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c446d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3649:1875732037043840:0@lo:400:kworker.0 00000100:00100000:1.0:1788837915.068143:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837915.068174:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037044352:0@lo:400:kworker.0 00000100:00100000:1.0:1788837915.068206:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837915.068224:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732037044864:0@lo:400:kworker.0 00000100:00100000:1.0:1788837915.068243:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837915.068257:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788837915.068263:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037044224:0@lo:400:kworker.0 00000100:00100000:1.0:1788837915.068283:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837915.068294:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037044736:0@lo:400:kworker.0 00000100:00100000:1.0:1788837915.068313:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837915.068323:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037045248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837915.068342:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837915.068366:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037044352 00000100:00100000:1.0:1788837915.068371:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037044352 00000100:00100000:1.0:1788837915.068396:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788837915.068403:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037044352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837915.071059:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037044864 00000100:00100000:3.0:1788837915.071076:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037044864 00000100:00100000:1.0:1788837915.071212:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037044352:12345-0@lo:400:kworker.0 Request processed in 2804us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837915.071225:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788837915.071296:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037044352:0@lo:400:kworker.0 00000100:00100000:1.0:1788837915.071329:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037045248 00000100:00100000:1.0:1788837915.071333:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037045248 00000100:00100000:1.0:1788837915.071369:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837915.071378:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037045248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788837915.071402:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788837915.071473:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037045248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (3129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837915.071495:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837915.071529:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037045248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837915.071550:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037044224 00000100:00100000:1.0:1788837915.071553:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037044224 00000100:00100000:0.0:1788837915.073009:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788837915.073114:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037043840 00000100:00100000:0.0:1788837915.073121:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037043840 00000100:00100000:0.0:1788837915.073158:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788837915.073167:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad2a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3649:x1875732037043840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837915.073239:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad2a07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3649:x1875732037043840:12345-0@lo:400:kworker.0 Request processed in 73us (5379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837915.073245:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788837915.073281:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3649:1875732037043840:0@lo:400:kworker.0 00000100:00100000:0.0:1788837915.073314:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037044736 00000100:00100000:0.0:1788837915.073317:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037044736 00000100:00100000:0.0:1788837915.073339:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837915.073345:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732037045120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837915.073377:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875732037045120:12345-0@lo:400:kworker.0 Request processed in 33us (6122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837915.073382:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837915.073395:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788837915.073401:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732037044736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837915.073443:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732037044736:12345-0@lo:400:kworker.0 Request processed in 29us (5116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837915.073461:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788837915.073490:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037044736:0@lo:400:kworker.0 00000100:00080000:0.0:1788837915.073544:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837915.073548:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788837915.073575:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037044096:0@lo:400:kworker.0 00000100:00100000:0.0:1788837915.073588:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875732037044608:0@lo:400:kworker.0 00010000:00080000:0.0:1788837915.073607:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c3dd5f80 x1875732037045120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837915.073616:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875732037045120:0@lo:400:kworker.0 00000100:00100000:0.0:1788837915.073627:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c446d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037043968:0@lo:400:kworker.0 00000100:00100000:0.0:1788837915.073640:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037044480:0@lo:400:kworker.0 00000100:00100000:0.0:1788837915.073653:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037044992:0@lo:400:kworker.0 00000100:00100000:3.0:1788837915.078671:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788837915.078701:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732037044864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837915.078851:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875732037044864:12345-0@lo:400:kworker.0 Request processed in 166us (10606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837915.079472:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788837915.079835:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ad17af800 x1875732037044864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837915.079841:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788837915.079850:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875732037044864:0@lo:400:kworker.0 00000100:00100000:1.0:1788837915.079853:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037044224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837915.079902:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875732037044224:12345-0@lo:400:kworker.0 Request processed in 52us (11617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837915.079909:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788837915.080038:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875732037044224:0@lo:400:kworker.0 00000040:00080000:1.0:1788837915.385994:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788837915.579475:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837915.579497:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affbd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037045376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837915.579570:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837915.579616:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037045376 00000100:00100000:0.0:1788837915.579624:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037045376 00000100:00100000:0.0:1788837915.579682:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788837915.579692:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037045376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837915.579728:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788837915.579802:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037045376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837915.579811:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788837915.579889:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affbd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037045376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837915.580949:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837915.580964:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037045504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837915.581017:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837915.581070:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037045504 00000100:00100000:1.0:1788837915.581076:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037045504 00000100:00100000:1.0:1788837915.581111:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788837915.581119:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037045504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788837915.581147:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788837915.581185:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037045504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837915.581192:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788837915.581231:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037045504:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788837915.960968:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788837916.091021:0:19523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 067bdd78-c556-4265-9b97-e4112a37245c 00000001:00080000:1.0:1788837916.091034:0:19523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1788837916.564727:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837916.564859:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012847744 00000100:00100000:3.0:1788837916.564870:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012847744 00000100:00100000:3.0:1788837916.564954:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:3.0:1788837916.564965:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+7:14981:x1875732012847744:12345-192.168.201.3@tcp:41:lfs.0 00000004:00000024:3.0:1788837916.564999:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788837916.565084:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+7:14981:x1875732012847744:12345-192.168.201.3@tcp:41:lfs.0 Request processed in 121us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837916.565092:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00080000:0.0:1788837916.565703:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837916.575616:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837916.576168:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012847872 00000100:00100000:0.0:1788837916.576179:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012847872 00000100:00100000:0.0:1788837916.576255:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:0.0:1788837916.576264:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+6:14981:x1875732012847872:12345-192.168.201.3@tcp:41:lfs.0 00000004:00000024:0.0:1788837916.576298:0:19205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788837916.576380:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+6:14981:x1875732012847872:12345-192.168.201.3@tcp:41:lfs.0 Request processed in 118us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837916.576388:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00080000:2.0:1788837916.576479:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837916.580879:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837916.581531:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012848000 00000100:00100000:1.0:1788837916.581555:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012848000 00000100:00100000:1.0:1788837916.581631:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:1.0:1788837916.581643:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:067bdd78-c556-4265-9b97-e4112a37245c+6:14981:x1875732012848000:12345-192.168.201.3@tcp:13:lfs.0 00002000:00000024:1.0:1788837916.581678:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788837916.581770:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:067bdd78-c556-4265-9b97-e4112a37245c+6:14981:x1875732012848000:12345-192.168.201.3@tcp:13:lfs.0 Request processed in 129us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837916.581813:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00080000:2.0:1788837916.581880:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837916.593326:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837916.597288:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012848128 00000100:00100000:2.0:1788837916.597305:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012848128 00000100:00100000:2.0:1788837916.597397:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:2.0:1788837916.597417:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:067bdd78-c556-4265-9b97-e4112a37245c+5:14981:x1875732012848128:12345-192.168.201.3@tcp:13:lfs.0 00002000:00000024:2.0:1788837916.597454:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788837916.597789:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837916.597846:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:067bdd78-c556-4265-9b97-e4112a37245c+5:14981:x1875732012848128:12345-192.168.201.3@tcp:13:lfs.0 Request processed in 430us (4528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837916.597855:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:3.0:1788837916.843561:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837916.843725:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012848256 00000100:00100000:2.0:1788837916.843735:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012848256 00000100:00100000:2.0:1788837916.843843:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 133 00000100:00100000:2.0:1788837916.843854:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+10:15014:x1875732012848256:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788837916.843871:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837916.843888:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6dac00/0x57f6d4e926af0608 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003ee73 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837916.843918:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6dac00/0x57f6d4e926af0608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee73 expref: 11 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837916.843930:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6dac00/0x57f6d4e926af0608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee73 expref: 11 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837916.843940:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6dac00, rc 0) 00000100:00100000:2.0:1788837916.844002:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:15014:x1875732012848256:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 151us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837916.844009:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 133 00000100:00100000:3.0:1788837916.875678:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837916.875806:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012848384 00000100:00100000:0.0:1788837916.875817:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012848384 00000100:00100000:0.0:1788837916.875881:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 134 00000100:00100000:0.0:1788837916.875890:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:15014:x1875732012848384:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788837916.876050:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:15014:x1875732012848384:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 161us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837916.876058:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 134 00000100:00100000:1.0:1788837916.895186:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837916.895295:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012848512 00000100:00100000:0.0:1788837916.895305:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012848512 00000100:00100000:0.0:1788837916.895367:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 135 00000100:00100000:0.0:1788837916.895376:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:15014:x1875732012848512:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788837916.895534:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:15014:x1875732012848512:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 158us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837916.895543:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 135 00000100:00100000:3.0:1788837916.902053:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837916.902874:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012848640 00000100:00100000:2.0:1788837916.902885:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012848640 00000100:00100000:2.0:1788837916.902947:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 136 00000100:00100000:2.0:1788837916.902958:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:15020:x1875732012848640:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788837916.903170:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:15020:x1875732012848640:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 212us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837916.903188:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 136 00000100:00100000:2.0:1788837916.935053:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837916.935160:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012848768 00000100:00100000:3.0:1788837916.935187:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012848768 00000100:00100000:3.0:1788837916.935248:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 137 00000100:00100000:3.0:1788837916.935257:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:15020:x1875732012848768:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837916.935426:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:15020:x1875732012848768:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 170us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837916.935435:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 137 00000100:00100000:1.0:1788837916.946231:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837916.946334:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012848896 00000100:00100000:0.0:1788837916.946346:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012848896 00000100:00100000:0.0:1788837916.946436:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 138 00000100:00100000:0.0:1788837916.946447:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:15020:x1875732012848896:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788837916.946609:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:15020:x1875732012848896:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 158us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837916.946617:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 138 00000100:00100000:0.0:1788837916.954811:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837916.956906:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012849024 00000100:00100000:2.0:1788837916.956922:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012849024 00000100:00100000:2.0:1788837916.956996:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 139 00000100:00100000:2.0:1788837916.957007:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:15014:x1875732012849024:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788837916.957027:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837916.957046:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6db600/0x57f6d4e926af060f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003eea4 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837916.957080:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6db600/0x57f6d4e926af060f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eea4 expref: 12 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837916.957091:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6db600/0x57f6d4e926af060f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eea4 expref: 12 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837916.957099:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6db600, rc 0) 00000100:00100000:2.0:1788837916.957177:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+12:15014:x1875732012849024:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 171us (2400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837916.957184:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 139 00000100:00100000:2.0:1788837916.964899:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837916.965112:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012849152 00000100:00100000:3.0:1788837916.965123:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012849152 00000100:00100000:3.0:1788837916.965187:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 140 00000100:00100000:3.0:1788837916.965207:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+12:15014:x1875732012849152:12345-192.168.201.3@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788837916.965234:0:17194:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788837916.965258:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788837916.965262:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788837916.965264:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788837916.965266:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788837916.965268:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788837916.969121:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+12:15014:x1875732012849152:12345-192.168.201.3@tcp:256:mount.lustre.0 Request processed in 3912us (4220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837916.969138:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 140 00000100:00100000:1.0:1788837916.975722:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837916.975850:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012849280 00000100:00100000:2.0:1788837916.975860:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012849280 00000100:00100000:2.0:1788837916.975969:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 141 00000100:00100000:2.0:1788837916.975979:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+12:15014:x1875732012849280:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788837916.975993:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837916.976021:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926af0616 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003eeab expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837916.976048:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926af0616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eeab expref: 13 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837916.976056:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926af0616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eeab expref: 13 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837916.976063:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6dbc00, rc 0) 00000100:00100000:2.0:1788837916.976114:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:15014:x1875732012849280:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 136us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837916.976120:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 141 00000100:00100000:2.0:1788837916.979843:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837916.980096:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012849408 00000100:00100000:3.0:1788837916.980105:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012849408 00000100:00100000:3.0:1788837916.980161:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 142 00000100:00100000:3.0:1788837916.980171:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:15014:x1875732012849408:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788837916.980478:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:15014:x1875732012849408:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 307us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837916.980486:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 142 00000100:00100000:1.0:1788837916.984036:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00010000:00010000:1.0:1788837916.986660:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837916.987215:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012849536 00000100:00100000:2.0:1788837916.987230:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012849536 00000100:00100000:2.0:1788837916.987301:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 143 00000100:00100000:2.0:1788837916.987312:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:15014:x1875732012849536:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788837916.987496:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:15014:x1875732012849536:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 185us (3470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837916.987504:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 143 00000100:00100000:1.0:1788837916.991044:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837916.991184:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012849664 00000100:00100000:3.0:1788837916.991196:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012849664 00000100:00100000:3.0:1788837916.991255:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 144 00000100:00100000:3.0:1788837916.991265:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:15026:x1875732012849664:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788837916.991556:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:15026:x1875732012849664:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 290us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837916.991565:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 144 00000100:00100000:3.0:1788837916.997223:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837916.997335:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012849792 00000100:00100000:0.0:1788837916.997346:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012849792 00000100:00100000:0.0:1788837916.997418:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 145 00000100:00100000:0.0:1788837916.997429:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:15026:x1875732012849792:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788837916.997588:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:15026:x1875732012849792:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 161us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837916.997597:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 145 00000100:00100000:1.0:1788837917.016067:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837917.016147:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837917.016262:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012849920 00000100:00100000:3.0:1788837917.016273:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012849920 00000100:00100000:3.0:1788837917.016308:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012850176 00000100:00100000:3.0:1788837917.016311:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012850176 00000100:00100000:3.0:1788837917.016345:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788837917.016352:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875732012849920:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788837917.016387:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8cd2a6f9-4711-474b-ad66-0a44190716b9@192.168.201.3@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1788837917.016463:0:17200:0:(genops.c:1385:class_connect()) connect: client 8cd2a6f9-4711-474b-ad66-0a44190716b9, cookie 0x57f6d4e926af061d 00000004:00100000:3.0:1788837917.016493:0:17200:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788837917.016590:0:17200:0:(import.c:65:import_set_state_nolock()) ffff889ac6be1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837917.016675:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2392:x1875732012849920:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 321us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837917.016682:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788837917.016701:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:3.0:1788837917.016705:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875732012850176:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788837917.016720:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 8cd2a6f9-4711-474b-ad66-0a44190716b9@192.168.201.3@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1788837917.016743:0:17200:0:(genops.c:1385:class_connect()) connect: client 8cd2a6f9-4711-474b-ad66-0a44190716b9, cookie 0x57f6d4e926af0624 00000004:00100000:3.0:1788837917.016756:0:17200:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788837917.016872:0:17200:0:(import.c:65:import_set_state_nolock()) ffff889ac6be1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837917.016897:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2392:x1875732012850176:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 190us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837917.016904:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:1.0:1788837917.027159:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837917.027408:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012850432 00000100:00100000:3.0:1788837917.027419:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012850432 00000100:00100000:3.0:1788837917.027501:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:3.0:1788837917.027512:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:15014:x1875732012850432:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788837917.027540:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788837917.028108:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:15014:x1875732012850432:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 595us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837917.028116:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00080000:0.0:1788837917.028189:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837917.029175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837917.029221:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837917.033281:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837917.042078:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012850304 00000100:00100000:2.0:1788837917.042098:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012850304 00000100:00100000:2.0:1788837917.042185:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012850048 00000100:00100000:2.0:1788837917.042189:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012850048 00000100:00080000:0.0:1788837917.042390:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788837917.043923:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012850560 00000100:00100000:0.0:1788837917.043935:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012850560 00000100:00100000:0.0:1788837917.043988:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:0.0:1788837917.043998:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:0:x1875732012850304:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788837917.044034:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788837917.044130:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:0:x1875732012850304:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 132us (14960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837917.044139:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:0.0:1788837917.044185:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:0.0:1788837917.044192:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+7:15014:x1875732012850560:12345-192.168.201.3@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788837917.044246:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+7:15014:x1875732012850560:12345-192.168.201.3@tcp:40:mount.lustre.0 Request processed in 55us (10974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837917.044253:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:2.0:1788837917.044592:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:2.0:1788837917.044610:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:0:x1875732012850048:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788837917.044688:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788837917.044729:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:0:x1875732012850048:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 130us (15508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837917.044736:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:0.0:1788837917.050967:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837917.051001:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837917.051033:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837917.051145:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012850944 00000100:00100000:3.0:1788837917.051155:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012850944 00000100:00100000:3.0:1788837917.051220:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:3.0:1788837917.051229:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:15014:x1875732012850944:12345-192.168.201.3@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788837917.051306:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:15014:x1875732012850944:12345-192.168.201.3@tcp:900:mount.lustre.0 Request processed in 77us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837917.051314:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:1.0:1788837917.051593:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012850688 00000100:00100000:1.0:1788837917.051598:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012850688 00000100:00100000:1.0:1788837917.051637:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012850816 00000100:00100000:1.0:1788837917.051640:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012850816 00000100:00100000:1.0:1788837917.051659:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:1.0:1788837917.051665:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c446d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875732012850688:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788837917.051691:0:18709:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8cd2a6f9-4711-474b-ad66-0a44190716b9@192.168.201.3@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1788837917.051723:0:18709:0:(genops.c:1385:class_connect()) connect: client 8cd2a6f9-4711-474b-ad66-0a44190716b9, cookie 0x57f6d4e926af062b 00002000:00100000:1.0:1788837917.051737:0:18709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8cd2a6f9-4711-474b-ad66-0a44190716b9/ffff889affb4e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788837917.051748:0:18709:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788837917.052063:0:18709:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788837917.052091:0:18709:0:(import.c:65:import_set_state_nolock()) ffff889affb4c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837917.052132:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c446d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2392:x1875732012850688:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 465us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837917.052138:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:1.0:1788837917.052155:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:1.0:1788837917.052160:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875732012850816:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788837917.052177:0:18709:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8cd2a6f9-4711-474b-ad66-0a44190716b9@192.168.201.3@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1788837917.052193:0:18709:0:(genops.c:1385:class_connect()) connect: client 8cd2a6f9-4711-474b-ad66-0a44190716b9, cookie 0x57f6d4e926af0632 00002000:00100000:1.0:1788837917.052280:0:18709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8cd2a6f9-4711-474b-ad66-0a44190716b9/ffff889affb48800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788837917.052288:0:18709:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788837917.052331:0:18709:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788837917.052347:0:18709:0:(import.c:65:import_set_state_nolock()) ffff889ae7f51000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837917.052369:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2392:x1875732012850816:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 207us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837917.052375:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:0.0:1788837917.057263:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837917.057492:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012851072 00000100:00100000:1.0:1788837917.057502:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012851072 00000100:00100000:1.0:1788837917.057558:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:1.0:1788837917.057568:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:15014:x1875732012851072:12345-192.168.201.3@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788837917.065692:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788837917.066049:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:15014:x1875732012851072:12345-192.168.201.3@tcp:33:mount.lustre.0 Request processed in 8477us (8790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837917.066063:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:1.0:1788837917.284322:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837917.284433:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012851200 00000100:00100000:2.0:1788837917.284443:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012851200 00000100:00100000:2.0:1788837917.284504:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:2.0:1788837917.284513:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:15049:x1875732012851200:12345-192.168.201.3@tcp:101:mkdir.0 00010000:00010000:2.0:1788837917.284535:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837917.284558:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af0639 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eedc expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837917.284632:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af0640 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837917.284648:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af0640 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837917.284661:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af0640 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837917.284706:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788837917.284711:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788837917.284732:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af0640 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837917.284765:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af0639 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eedc expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837917.284813:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af0640 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eedc expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837917.285029:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1ef00) 00010000:00010000:2.0:1788837917.285032:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837917.285036:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6db000, rc 0) 00000100:00100000:2.0:1788837917.285105:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+7:15049:x1875732012851200:12345-192.168.201.3@tcp:101:mkdir.0 Request processed in 592us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837917.285112:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 22 00010000:00010000:0.0:1788837918.009437:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837919.035725:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837919.161958:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affbd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037045632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837919.162032:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837919.162189:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037045632 00000100:00100000:1.0:1788837919.162197:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037045632 00000100:00100000:1.0:1788837919.162260:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837919.162269:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037045632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837919.162312:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788837919.162369:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037045632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837919.162376:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837919.162418:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affbd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037045632:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788837919.162539:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788837920.064066:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837920.185156:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837920.185179:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037045760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837920.185259:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837920.185417:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037045760 00000100:00100000:0.0:1788837920.185425:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037045760 00000100:00100000:0.0:1788837920.185483:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788837920.185492:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037045760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837920.185514:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788837920.185566:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037045760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837920.185573:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788837920.185618:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837920.185650:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037045760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837920.186144:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037045888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837920.186173:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837920.186458:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837920.186469:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037046016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837920.186497:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837920.186529:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037045888 00000100:00100000:0.0:1788837920.186534:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037045888 00000100:00100000:0.0:1788837920.186572:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037046016 00000100:00100000:0.0:1788837920.186575:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037046016 00000100:00100000:0.0:1788837920.186590:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837920.186595:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037045888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788837920.186615:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000001:00100000:3.0:1788837920.191204:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8cd2a6f9-4711-474b-ad66-0a44190716b9 00000001:00100000:3.0:1788837920.191217:0:18703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 067bdd78-c556-4265-9b97-e4112a37245c 00000001:00100000:2.0:1788837920.192537:0:17180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8cd2a6f9-4711-474b-ad66-0a44190716b9 00000001:00100000:2.0:1788837920.192601:0:17180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 067bdd78-c556-4265-9b97-e4112a37245c 00000100:00100000:0.0:1788837920.193145:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037045888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6543us (6964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837920.193159:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788837920.193201:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affbd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037046144:0@lo:400:kworker.0 00000100:00100000:0.0:1788837920.193276:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837920.193426:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037046144 00000100:00100000:0.0:1788837920.193433:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037046144 00000100:00100000:0.0:1788837920.193474:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788837920.193481:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3651:x1875732037046144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837920.193530:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3651:x1875732037046144:12345-0@lo:400:kworker.0 Request processed in 49us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837920.193536:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1788837920.193578:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837920.193602:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affbd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037046144:0@lo:400:kworker.0 00000100:00100000:0.0:1788837920.193626:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837920.193634:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037046016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837920.193650:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788837920.193688:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037046016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (7190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837920.193693:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837920.193715:0:3651:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788837920.193744:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ac85eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037046016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837920.194280:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037045888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837920.194300:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837920.194309:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affbdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037046272:0@lo:400:kworker.0 00000100:00100000:2.0:1788837920.194361:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837920.194403:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037046272 00000100:00100000:2.0:1788837920.194407:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037046272 00000100:00100000:2.0:1788837920.194440:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788837920.194447:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037046272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837920.194488:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037046272:12345-0@lo:400:kworker.0 Request processed in 42us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837920.194494:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788837920.194524:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affbdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037046272:0@lo:400:kworker.0 00000001:00100000:3.0:1788837920.196176:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8cd2a6f9-4711-474b-ad66-0a44190716b9 00000001:00100000:3.0:1788837920.196187:0:17933:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 067bdd78-c556-4265-9b97-e4112a37245c 00000100:00100000:2.0:1788837920.196562:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affbd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037046400:0@lo:400:kworker.0 00000100:00100000:2.0:1788837920.196630:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837920.196706:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037046400 00000100:00100000:3.0:1788837920.196729:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037046400 00000100:00100000:3.0:1788837920.196814:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788837920.196824:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037046400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837920.197201:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837920.197212:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affbdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732037046528:0@lo:400:kworker.0 00000100:00100000:1.0:1788837920.197257:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837920.197303:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affbd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037046656:0@lo:400:kworker.0 00000100:00100000:1.0:1788837920.197328:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837920.197370:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037046656 00000100:00100000:1.0:1788837920.197374:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037046656 00000100:00100000:1.0:1788837920.197403:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788837920.197409:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037046656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837920.197447:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037046656:12345-0@lo:400:kworker.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837920.197455:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788837920.197495:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affbd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037046656:0@lo:400:kworker.0 00000100:00100000:0.0:1788837920.197568:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037046528 00000100:00100000:0.0:1788837920.197572:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037046528 00000100:00100000:0.0:1788837920.197604:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788837920.197611:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732037046528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837920.197655:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875732037046528:12345-0@lo:400:kworker.0 Request processed in 45us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837920.197662:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788837920.197685:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037046784:0@lo:400:kworker.0 00000100:00100000:0.0:1788837920.197709:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837920.197967:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affbdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875732037046528:0@lo:400:kworker.0 00000100:00100000:3.0:1788837920.198262:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037046400:12345-0@lo:400:kworker.0 Request processed in 1439us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837920.198270:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837920.198423:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037046784 00000100:00100000:1.0:1788837920.198428:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037046784 00000100:00100000:1.0:1788837920.198454:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788837920.198460:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037046784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837920.198499:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037046784:12345-0@lo:400:kworker.0 Request processed in 39us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837920.198506:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788837920.198577:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037047040:0@lo:400:kworker.0 00000100:00100000:1.0:1788837920.198604:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837920.198627:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037047040 00000100:00100000:1.0:1788837920.198631:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037047040 00000100:00100000:1.0:1788837920.198658:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788837920.198664:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037047040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837920.198695:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037047040:12345-0@lo:400:kworker.0 Request processed in 31us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837920.198701:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788837920.198730:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ad17aca80 x1875732037047040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837920.198742:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037047040:0@lo:400:kworker.0 00000100:00100000:1.0:1788837920.198768:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837920.199047:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037047168:0@lo:400:kworker.0 00000100:00100000:1.0:1788837920.199076:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837920.199100:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037047168 00000100:00100000:1.0:1788837920.199104:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037047168 00000100:00100000:1.0:1788837920.199128:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788837920.199134:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ad17ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732037047168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837920.199166:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ad17ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732037047168:12345-0@lo:400:kworker.0 Request processed in 32us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837920.199172:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788837920.199196:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037047168:0@lo:400:kworker.0 00000100:00100000:0.0:1788837920.199431:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037047296:0@lo:400:kworker.0 00000100:00100000:0.0:1788837920.199458:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837920.199493:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037046784:0@lo:400:kworker.0 00000100:00100000:0.0:1788837920.199506:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837920.199511:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732037046912:0@lo:400:kworker.0 00000100:00100000:0.0:1788837920.199532:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788837920.199573:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837920.199578:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837920.199695:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037047296 00000100:00100000:3.0:1788837920.199700:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037047296 00000100:00100000:3.0:1788837920.199743:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037046912 00000100:00100000:3.0:1788837920.199746:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037046912 00000100:00100000:3.0:1788837920.199768:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788837920.199803:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732037047296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837920.199837:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732037047296:12345-0@lo:400:kworker.0 Request processed in 36us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837920.199844:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788837920.199855:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788837920.199861:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732037046912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837920.199887:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875732037046912:12345-0@lo:400:kworker.0 Request processed in 27us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837920.199893:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788837920.200884:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837920.200892:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788837920.200928:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875732037046912:0@lo:400:kworker.0 00010000:00080000:0.0:1788837920.200945:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889ad17aca80 x1875732037047296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837920.200956:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037047296:0@lo:400:kworker.0 00000100:00100000:2.0:1788837920.201367:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affbd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037046400:0@lo:400:kworker.0 00000001:02000400:1.0:1788837920.409103:0:20078:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788837920.701702:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837920.701727:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037047424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837920.701817:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837920.701987:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037047424 00000100:00100000:0.0:1788837920.701995:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037047424 00000100:00100000:0.0:1788837920.702042:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788837920.702051:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037047424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837920.702087:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788837920.702134:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037047424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837920.702142:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788837920.702188:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c27bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037047424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837920.702628:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037047552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837920.702662:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837920.702696:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037047552 00000100:00100000:0.0:1788837920.702700:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037047552 00000100:00100000:0.0:1788837920.702725:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788837920.702732:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c27bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037047552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837920.702751:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788837920.702802:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c27bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037047552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837920.702809:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788837920.702836:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037047552:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788837921.081430:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837921.657518:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788837922.104964:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837922.299642:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837922.299692:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837922.299719:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837922.299749:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837922.299771:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837922.299817:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837922.299852:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837922.299870:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837922.299890:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837922.299915:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012851840 00000100:00100000:3.0:1788837922.299926:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012851840 00000100:00100000:3.0:1788837922.299977:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012852352 00000100:00100000:3.0:1788837922.299981:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012852352 00000100:00100000:3.0:1788837922.299993:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012851712 00000100:00100000:3.0:1788837922.299995:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012851712 00000100:00100000:3.0:1788837922.300006:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012852224 00000100:00100000:3.0:1788837922.300008:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012852224 00000100:00100000:3.0:1788837922.300022:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:3.0:1788837922.300031:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+5:2394:x1875732012851840:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837922.300102:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+5:2394:x1875732012851840:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 72us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837922.300110:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:3.0:1788837922.300127:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:3.0:1788837922.300133:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2394:x1875732012852352:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837922.300157:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2394:x1875732012852352:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837922.300163:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:3.0:1788837922.300173:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:3.0:1788837922.300179:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+5:2393:x1875732012851712:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837922.300202:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+5:2393:x1875732012851712:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837922.300207:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:3.0:1788837922.300240:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:3.0:1788837922.300246:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2393:x1875732012852224:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837922.300271:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2393:x1875732012852224:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837922.300276:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00080000:3.0:1788837922.300298:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837922.300312:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837922.300426:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012851328 00000100:00100000:2.0:1788837922.300431:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012851328 00000100:00100000:2.0:1788837922.300472:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 147 00000100:00100000:2.0:1788837922.300478:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:2394:x1875732012851328:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837922.300504:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:2394:x1875732012851328:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 27us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837922.300511:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 147 00000100:00100000:1.0:1788837922.300649:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012851456 00000100:00100000:1.0:1788837922.300653:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012851456 00000100:00100000:1.0:1788837922.300700:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012851584 00000100:00100000:1.0:1788837922.300704:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012851584 00000100:00100000:1.0:1788837922.300719:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012852096 00000100:00100000:1.0:1788837922.300722:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012852096 00000100:00100000:1.0:1788837922.300732:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012851968 00000100:00100000:1.0:1788837922.300734:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012851968 00000100:00100000:1.0:1788837922.300747:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:1.0:1788837922.300754:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+6:2393:x1875732012851456:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837922.300813:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+6:2393:x1875732012851456:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 59us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837922.300820:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:1.0:1788837922.300833:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:1.0:1788837922.300839:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+5:2394:x1875732012851584:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837922.300862:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+5:2394:x1875732012851584:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837922.300868:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:1.0:1788837922.300879:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:1.0:1788837922.300884:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2394:x1875732012852096:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837922.300905:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2394:x1875732012852096:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 20us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837922.300911:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:1.0:1788837922.300921:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:1.0:1788837922.300926:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2393:x1875732012851968:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837922.300943:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2393:x1875732012851968:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 17us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837922.300958:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00080000:2.0:1788837922.301174:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837922.301178:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788837923.128995:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788837923.264026:0:19523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8cd2a6f9-4711-474b-ad66-0a44190716b9 00000020:00000080:3.0:1788837924.023143:0:20226:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7fec3830 20000000:00000080:3.0:1788837924.023164:0:20226:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff889b00d19800 uarg=0000000000000000 20000000:01000000:3.0:1788837924.023210:0:20226:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788837924.023216:0:20226:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788837924.023222:0:20226:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788837924.024531:0:20227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788837924.024685:0:20226:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788837924.044302:0:20226:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788837924.044655:0:20226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.044676:0:20226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac1325a00/0x57f6d4e926af02dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af02d5 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.044684:0:20226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac1325800/0x57f6d4e926af02ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af02e3 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.044691:0:20226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac1324600/0x57f6d4e926af0329 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0322 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.044698:0:20226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0487 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0480 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.044708:0:20226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889ac2b16a00/0x57f6d4e926af05d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee3b expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.044714:0:20226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926af0616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eeab expref: 12 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.044721:0:20226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.044770:0:20226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926af0616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eeab expref: 12 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.044814:0:20226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926af0616 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eeab expref: 12 pid: 17195 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837924.044846:0:20226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1875732037047680:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788837924.044952:0:20226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac2b16a00/0x57f6d4e926af05d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ee3b expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.044961:0:20226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ac2b16a00/0x57f6d4e926af05d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ee3b expref: 12 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837924.044970:0:20226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1875732037047808:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788837924.045017:0:20226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0480 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.045025:0:20226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0487 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0480 expref: 23 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837924.045034:0:20226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1875732037047936:0@lo:104: 00000100:00100000:1.0:1788837924.045073:0:20226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837924.045114:0:20226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac1324600/0x57f6d4e926af0329 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af0322 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.045123:0:20226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ac1324600/0x57f6d4e926af0329 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af0322 expref: 23 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837924.045131:0:20226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affbdbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1875732037048064:0@lo:104: 00000100:00100000:1.0:1788837924.045152:0:20226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788837924.045176:0:20226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac1325800/0x57f6d4e926af02ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af02e3 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837924.045297:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037047936 00000100:00100000:3.0:1788837924.045307:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037047936 00000100:00100000:0.0:1788837924.045348:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037048064 00000100:00100000:0.0:1788837924.045354:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037048064 00000100:00100000:3.0:1788837924.045359:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837924.045370:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+4:20226:x1875732037047936:12345-0@lo:104: 00010000:00010000:3.0:1788837924.045383:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0487 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837924.045434:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837924.045440:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+4:20226:x1875732037047936:12345-0@lo:104: Request processed in 74us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837924.045447:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837924.045465:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788837924.045471:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affbd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:20226:x1875732037048064:12345-0@lo:104: 00010000:00010000:3.0:1788837924.045478:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0329 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837924.045519:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788837924.045524:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affbd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:20226:x1875732037048064:12345-0@lo:104: Request processed in 54us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837924.045530:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788837924.045547:0:17953:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837924.045553:0:17953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0487 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837924.045560:0:17953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9b600 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:3.0:1788837924.045565:0:17953:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0487 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837924.045574:0:17953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0487 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837924.045576:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837924.045586:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af0329 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788837924.045587:0:17953:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0487 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837924.045606:0:17953:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837924.045607:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8899c1a9be00 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:0.0:1788837924.045612:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af0329 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837924.046816:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af0329 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837924.046833:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af0329 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837924.046839:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788837924.046863:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0329 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837924.046870:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837924.046904:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0329 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837924.046911:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c1a9be00/0x57f6d4e926af0322 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0329 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837924.046928:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837924.046930:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837924.046932:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837924.046963:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037048448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837924.047011:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837924.047061:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037048448 00000100:00100000:0.0:1788837924.047067:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037048448 00010000:00010000:0.0:1788837924.047089:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac1324600/0x57f6d4e926af0329 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0322 expref: 24 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837924.047112:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788837924.047119:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3651:x1875732037048448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837924.047130:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837924.047134:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac1324600/0x57f6d4e926af0329 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0322 expref: 24 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.047393:0:20226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ac1325800/0x57f6d4e926af02ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af02e3 expref: 24 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837924.047415:0:20226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3347480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1875732037048192:0@lo:104: 00000100:00100000:1.0:1788837924.047445:0:20226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837924.047580:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037048192 00000100:00100000:2.0:1788837924.047585:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037048192 00000100:00100000:2.0:1788837924.047615:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837924.047623:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:20226:x1875732037048192:12345-0@lo:104: 00010000:00010000:2.0:1788837924.047633:0:17184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af02ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.047681:0:17184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788837924.047686:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:20226:x1875732037048192:12345-0@lo:104: Request processed in 65us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837924.047693:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788837924.047725:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837924.047731:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af02ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.047739:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c9400 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837924.047743:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af02ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.047752:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af02ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837924.047758:0:17953:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0487 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837924.047758:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af02ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837924.047772:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788837924.047962:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af02ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.047970:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837924.047987:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af02ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.047993:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af02e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af02ea expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.048013:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837924.048015:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837924.048017:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837924.048031:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837924.048044:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3649:1875732037048576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837924.048077:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837924.048110:0:17186:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788837924.048118:0:17186:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788837924.048615:0:17953:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788837924.048637:0:17953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0487 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837924.048644:0:17953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8899c1a9b600/0x57f6d4e926af0480 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af0487 expref: -99 pid: 19522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837924.048667:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837924.048669:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837924.048671:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837924.048774:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3649:1875732037048320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837924.048811:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac1324600/0x57f6d4e926af0329 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0322 expref: 24 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837924.048834:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788837924.048865:0:20226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889ac1325a00/0x57f6d4e926af02dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x57f6d4e926af02d5 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.048878:0:20226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889ac1325a00/0x57f6d4e926af02dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x57f6d4e926af02d5 expref: 24 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837924.048888:0:20226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1875732037048704:0@lo:104: 00000100:00100000:0.0:1788837924.048897:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3651:x1875732037048448:12345-0@lo:103:ldlm_bl.0 Request processed in 1776us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837924.048906:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837924.048922:0:20226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837924.048930:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037048576 00000100:00100000:0.0:1788837924.048936:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037048576 00010000:00010000:0.0:1788837924.048958:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac1325800/0x57f6d4e926af02ea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af02e3 expref: 24 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837924.048963:0:20226:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ad0104180 going to sleep for 11 seconds 00000100:00100000:0.0:1788837924.048980:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788837924.048989:0:20226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1875732037047936:0@lo:104: 00000100:00100000:0.0:1788837924.048991:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3649:x1875732037048576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837924.049004:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837924.049007:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac1324600/0x57f6d4e926af0329 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0322 expref: 24 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837924.049012:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac1325800/0x57f6d4e926af02ea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af02e3 expref: 24 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837924.049022:0:20226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affbdbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1875732037048064:0@lo:104: 00010000:00010000:0.0:1788837924.049031:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac1325800/0x57f6d4e926af02ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af02e3 expref: 23 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837924.049036:0:20226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3347480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1875732037048192:0@lo:104: 00010000:00010000:0.0:1788837924.049047:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac1325800/0x57f6d4e926af02ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af02e3 expref: 23 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837924.049059:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837924.049073:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837924.049081:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:3649:x1875732037048576:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837924.049088:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788837924.049099:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037048320 00000100:00100000:1.0:1788837924.049105:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037048320 00000100:00100000:2.0:1788837924.049106:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3649:1875732037048576:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837924.049127:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0487 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0480 expref: 22 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837924.049135:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037048704 00000100:00100000:2.0:1788837924.049212:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037048704 00000100:00100000:2.0:1788837924.049251:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837924.049258:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:20226:x1875732037048704:12345-0@lo:104: 00010000:00010000:2.0:1788837924.049269:0:17184:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af02dc expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.049320:0:17184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788837924.049325:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+3:20226:x1875732037048704:12345-0@lo:104: Request processed in 69us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837924.049331:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788837924.049346:0:17189:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837924.049351:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x57f6d4e926af02dc expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.049368:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7000 already unused, calling callback (ffffffffc122ac20) 10000000:00010000:2.0:1788837924.049371:0:17189:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x57f6d4e926af02dc expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.049379:0:17189:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x57f6d4e926af02dc expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788837924.049558:0:17189:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x57f6d4e926af02dc expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837924.049564:0:17189:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788837924.049588:0:17189:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af02dc expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.049594:0:17189:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788837924.049608:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af02dc expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.049614:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff889afbea7000/0x57f6d4e926af02d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x57f6d4e926af02dc expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.049628:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837924.049629:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837924.049631:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837924.049642:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037048832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837924.049671:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837924.049773:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037048832 00000100:00100000:2.0:1788837924.049801:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037048832 00000100:00100000:3.0:1788837924.049912:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3651:1875732037048448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837924.050050:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837924.050072:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00010000:00010000:2.0:1788837924.050255:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac1325a00/0x57f6d4e926af02dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af02d5 expref: 23 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837924.050294:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012852480 00000100:00100000:2.0:1788837924.050298:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012852480 00010000:00010000:2.0:1788837924.050314:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889ac2b16a00/0x57f6d4e926af05d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ee3b expref: 13 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837924.050324:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012852608 00000100:00100000:2.0:1788837924.050327:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012852608 00010000:00010000:2.0:1788837924.050337:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926af0616 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eeab expref: 14 pid: 17195 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837924.050348:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837924.050355:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:3649:x1875732037048320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837924.050365:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837924.050370:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0487 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af0480 expref: 23 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.050379:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af0480 expref: 23 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.050579:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8899c1a9b400/0x57f6d4e926af0487 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af0480 expref: 23 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.050595:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837924.050652:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:3649:x1875732037048320:12345-0@lo:103:ldlm_bl.0 Request processed in 296us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837924.050661:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788837924.050683:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788837924.050692:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:2.0:1788837924.050693:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:3650:x1875732037048832:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837924.050708:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc2cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7253ef40-cd6d-4a26-9386-e23758a56a4e+14:2396:x1875732012852480:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837924.050718:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837924.050723:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac2b16a00/0x57f6d4e926af05d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ee3b expref: 14 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.050740:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac2b16a00/0x57f6d4e926af05d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ee3b expref: 14 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.050751:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837924.050826:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc2cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7253ef40-cd6d-4a26-9386-e23758a56a4e+14:2396:x1875732012852480:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 123us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837924.050834:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:1.0:1788837924.050850:0:17185:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788837924.050860:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:1.0:1788837924.050866:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:2396:x1875732012852608:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837924.050874:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837924.050879:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926af0616 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eeab expref: 13 pid: 17195 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.050895:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926af0616 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eeab expref: 13 pid: 17195 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837924.050904:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837924.050922:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:2396:x1875732012852608:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 56us (849us total) trans 0 rc 0/0 00010000:00010000:2.0:1788837924.050962:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837924.050970:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889ac1325a00/0x57f6d4e926af02dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x57f6d4e926af02d5 expref: 21 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.050981:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889ac1325a00/0x57f6d4e926af02dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x57f6d4e926af02d5 expref: 21 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.050994:0:17187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.051003:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.051017:0:17187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.051024:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.051032:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.051038:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.051044:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6c8400 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837924.051048:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.051056:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.051076:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.051086:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837924.051117:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:3650:x1875732037048832:12345-0@lo:103:ldlm_bl.0 Request processed in 427us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837924.051124:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788837924.051236:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3649:1875732037048320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788837924.051298:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3650:1875732037048832:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788837924.051374:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6dbc00/0x57f6d4e926af0616 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eeab expref: 13 pid: 17195 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837924.051568:0:20226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1875732037047680:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837924.051583:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac2b16a00/0x57f6d4e926af05d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ee3b expref: 12 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837924.051592:0:20226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889ad17af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1875732037047808:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837924.051602:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889ac1325a00/0x57f6d4e926af02dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x57f6d4e926af02d5 expref: 20 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837924.051609:0:20226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20226:1875732037048704:0@lo:104: 00010000:00010000:2.0:1788837924.051633:0:20226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.051642:0:20226:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.051648:0:20226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837924.051661:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889afa6c8400/0x57f6d4e926af0647 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837924.052504:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00010000:00010000:2.0:1788837924.157014:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837924.281023:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837924.282267:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037048960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837924.282376:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837924.282505:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037048960 00000100:00100000:3.0:1788837924.282515:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037048960 00000100:00100000:3.0:1788837924.282588:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788837924.282597:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037048960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837924.282626:0:18710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788837924.282687:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037048960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837924.282703:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788837924.282971:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837924.283053:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037048960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788837925.177608:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837925.309590:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037049088:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.309674:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837925.310345:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037049216:0@lo:400:kworker.0 00000100:00100000:3.0:1788837925.310388:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837925.310431:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037049728:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.311087:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037049600:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.311131:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.311155:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037050112:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.311177:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.311194:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037050624:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.311216:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.311265:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037049344:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.311306:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.311330:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037049856:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.311352:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.311370:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037050368:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.311391:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.311411:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c24e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037050880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837925.311434:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837925.311544:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837925.311568:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037050240:0@lo:400:kworker.0 00000100:00100000:3.0:1788837925.311594:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837925.311605:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c24e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037050752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837925.311624:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837925.311704:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037051008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837925.311730:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837925.312985:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037049216 00000100:00100000:0.0:1788837925.312996:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037049216 00000100:00100000:0.0:1788837925.313050:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037049728 00000100:00100000:0.0:1788837925.313054:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037049728 00000100:00100000:0.0:1788837925.313073:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788837925.313083:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037049216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837925.313162:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037049216:12345-0@lo:400:kworker.0 Request processed in 80us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837925.313170:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788837925.313187:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788837925.313194:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037049728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837925.313224:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037049728:12345-0@lo:400:kworker.0 Request processed in 31us (2768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837925.313230:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788837925.313268:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037050880 00000100:00100000:0.0:1788837925.313272:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037050880 00000100:00100000:0.0:1788837925.313309:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037050752 00000100:00100000:0.0:1788837925.313313:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037050752 00000100:00100000:0.0:1788837925.313326:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037051008 00000100:00100000:0.0:1788837925.313329:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037051008 00000100:00100000:0.0:1788837925.313343:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788837925.313349:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037050880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788837925.313370:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788837925.313406:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037050880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837925.313412:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788837925.313425:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788837925.313431:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037050752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837925.313441:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788837925.313467:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037050752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837925.313473:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788837925.313484:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788837925.313490:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037051008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788837925.313499:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788837925.313529:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037051008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837925.313535:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788837925.313550:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837925.313554:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837925.313592:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037051008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837925.313626:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037049216:0@lo:400:kworker.0 00000100:00100000:0.0:1788837925.313649:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037049728:0@lo:400:kworker.0 00000100:00100000:0.0:1788837925.313664:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c24e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037050752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837925.314059:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788837925.314076:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037049472:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.314118:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.314150:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037049984:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.314173:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.314195:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037050496:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.314219:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.314244:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c24e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037050880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837925.314296:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037049088 00000100:00100000:1.0:1788837925.314301:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037049088 00000100:00100000:1.0:1788837925.314335:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788837925.314350:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:3648:x1875732037049088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.314390:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:3648:x1875732037049088:12345-0@lo:400:kworker.0 Request processed in 42us (4716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837925.314396:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788837925.314425:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037049600 00000100:00100000:1.0:1788837925.314429:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037049600 00000100:00100000:1.0:1788837925.314447:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037050112 00000100:00100000:1.0:1788837925.314451:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037050112 00000100:00100000:1.0:1788837925.314462:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037050624 00000100:00100000:1.0:1788837925.314465:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037050624 00000100:00100000:1.0:1788837925.314486:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037050368 00000100:00100000:1.0:1788837925.314489:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037050368 00000100:00100000:1.0:1788837925.314501:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037050240 00000100:00100000:1.0:1788837925.314504:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037050240 00000100:00100000:1.0:1788837925.314515:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037050496 00000100:00100000:1.0:1788837925.314517:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037050496 00000100:00100000:1.0:1788837925.314531:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788837925.314537:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037049600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.314567:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037049600:12345-0@lo:400:kworker.0 Request processed in 30us (3435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837925.314573:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788837925.314585:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788837925.314591:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037050112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.314618:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037050112:12345-0@lo:400:kworker.0 Request processed in 27us (3439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837925.314624:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788837925.314635:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788837925.314641:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732037050624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.314692:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732037050624:12345-0@lo:400:kworker.0 Request processed in 39us (3463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837925.314699:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788837925.314711:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788837925.314717:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037050368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.314748:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037050368:12345-0@lo:400:kworker.0 Request processed in 32us (3356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837925.314755:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788837925.314766:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788837925.314772:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732037050240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.314834:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732037050240:12345-0@lo:400:kworker.0 Request processed in 62us (3240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837925.314841:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788837925.314853:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788837925.314859:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732037050496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.314899:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875732037050496:12345-0@lo:400:kworker.0 Request processed in 40us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837925.315811:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037049344 00000100:00100000:0.0:1788837925.315819:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037049344 00000100:00100000:0.0:1788837925.315847:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037049856 00000100:00100000:0.0:1788837925.315850:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037049856 00000100:00100000:0.0:1788837925.315863:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037049472 00000100:00100000:0.0:1788837925.315865:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037049472 00000100:00100000:0.0:1788837925.316102:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037049984 00000100:00100000:0.0:1788837925.316107:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037049984 00000100:00100000:0.0:1788837925.316126:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837925.316135:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037049344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837925.316188:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037049344:12345-0@lo:400:kworker.0 Request processed in 54us (4881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837925.316195:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788837925.316210:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837925.316216:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037049856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837925.316245:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037049856:12345-0@lo:400:kworker.0 Request processed in 29us (4892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837925.316260:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788837925.316271:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837925.316277:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac6fa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037049472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837925.316305:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac6fa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037049472:12345-0@lo:400:kworker.0 Request processed in 29us (2187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837925.316312:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788837925.316483:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788837925.316498:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037049984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837925.316530:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037049984:12345-0@lo:400:kworker.0 Request processed in 34us (2356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837925.316536:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788837925.317067:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788837925.317109:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837925.317115:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837925.317147:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037049088:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.317165:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037049600:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.317179:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037050112:0@lo:400:kworker.0 00010000:00080000:1.0:1788837925.317194:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889b00cb3800 x1875732037050624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837925.317216:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037050624:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.317272:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037050240:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.317300:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037049472:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.317311:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037049984:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.317321:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875732037050496:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.317332:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037049344:0@lo:400:kworker.0 00000100:00100000:1.0:1788837925.317343:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037049856:0@lo:400:kworker.0 00010000:00080000:1.0:1788837925.317356:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889b00cb0000 x1875732037050368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837925.317365:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037050368:0@lo:400:kworker.0 00000100:00100000:0.0:1788837925.425343:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837925.425446:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012852736 00000100:00100000:3.0:1788837925.425457:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012852736 00000100:00100000:3.0:1788837925.425518:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 149 00000100:00100000:3.0:1788837925.425528:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+11:14896:x1875732012852736:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837925.425545:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837925.425564:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afbea7400/0x57f6d4e926af064e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003eee3 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837925.425593:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afbea7400/0x57f6d4e926af064e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eee3 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837925.425605:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afbea7400/0x57f6d4e926af064e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eee3 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837925.425615:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea7400, rc 0) 00000100:00100000:3.0:1788837925.425680:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+12:14896:x1875732012852736:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 154us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837925.425688:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 149 10000000:01000000:0.0:1788837925.441085:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788837925.441096:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8899c36d1800 from 13 10000000:01000000:0.0:1788837925.441103:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788837925.441160:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837925.441172:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837925.441184:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837925.441211:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c24e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037051136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788837925.441292:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837925.441335:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b00d249c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837925.441394:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037051136 00000100:00100000:1.0:1788837925.441403:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037051136 00000100:00100000:1.0:1788837925.441467:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788837925.441477:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+20:17197:x1875732037051136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837925.441500:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837925.441515:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6c8000/0x57f6d4e926af065c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0655 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837925.441538:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6c8000/0x57f6d4e926af065c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0655 expref: 21 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837925.441549:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6c8000/0x57f6d4e926af065c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0655 expref: 21 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837925.441573:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6c8000, rc 0) 00000100:00100000:1.0:1788837925.441620:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:17197:x1875732037051136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837925.441631:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788837925.442019:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c24e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037051136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837925.442035:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af065c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837925.442044:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af065c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837925.442110:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c24e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037051264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837925.442151:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837925.442182:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b00d249c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837925.443174:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037051264 00000100:00100000:1.0:1788837925.443184:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037051264 00000100:00100000:1.0:1788837925.443223:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788837925.443232:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:17197:x1875732037051264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837925.443385:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:17197:x1875732037051264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837925.443392:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788837925.446087:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c24e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037051264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837925.446155:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c24e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037051392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837925.446229:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837925.446275:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889b00d249c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837925.448397:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037051392 00000100:00100000:1.0:1788837925.448411:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037051392 00000100:00100000:1.0:1788837925.448479:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788837925.448498:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:17197:x1875732037051392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837925.448650:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:17197:x1875732037051392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837925.448658:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788837925.448819:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c24e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037051392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788837925.449634:0:20281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:2.0:1788837925.454765:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837925.454830:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012852864 00000100:00100000:2.0:1788837925.454842:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012852864 00000100:00100000:2.0:1788837925.454897:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 153 00000100:00100000:2.0:1788837925.454919:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+12:14896:x1875732012852864:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837925.455069:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+12:14896:x1875732012852864:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 152us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837925.455077:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 153 00000020:01000000:1.0:1788837925.459837:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788837925.459880:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788837925.459892:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af065c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837925.459915:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889ac2b16c00/0x57f6d4e926af0655 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af065c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837925.459939:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788837925.459941:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ae7d4a800 from 13 10000000:01000000:1.0:1788837925.459944:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788837925.459985:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837925.459993:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837925.460004:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837925.460030:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037051520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788837925.460101:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.460153:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6922300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837925.460323:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037051520 00000100:00100000:2.0:1788837925.460331:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037051520 00000100:00100000:2.0:1788837925.460387:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788837925.460397:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+21:17197:x1875732037051520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837925.460412:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837925.460424:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afa6da600/0x57f6d4e926af066a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0663 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837925.460448:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afa6da600/0x57f6d4e926af066a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0663 expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837925.460472:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afa6da600/0x57f6d4e926af066a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0663 expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837925.460480:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6da600, rc 0) 00000100:00100000:2.0:1788837925.460529:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:17197:x1875732037051520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837925.460536:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788837925.460650:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037051520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837925.460665:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af066a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837925.460675:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af066a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837925.460830:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037051648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837925.460858:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.460875:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6922300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837925.460996:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037051648 00000100:00100000:2.0:1788837925.461001:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037051648 00000100:00100000:2.0:1788837925.461035:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788837925.461043:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:17197:x1875732037051648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837925.461155:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:17197:x1875732037051648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837925.461161:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788837925.461257:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037051648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837925.461287:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037051776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837925.461334:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.461359:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6922300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837925.461402:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037051776 00000100:00100000:3.0:1788837925.461406:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037051776 00000100:00100000:3.0:1788837925.461440:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788837925.461448:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:17197:x1875732037051776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837925.461534:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:17197:x1875732037051776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837925.461541:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788837925.461656:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037051776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788837925.462602:0:20283:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788837925.462848:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788837925.462869:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788837925.462877:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af066a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837925.462888:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c8400/0x57f6d4e926af0663 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af066a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837925.462899:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788837925.462969:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ac444e800 from 13 10000000:01000000:1.0:1788837925.462973:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788837925.463001:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837925.463010:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837925.463019:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837925.463039:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037051904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788837925.463088:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.463128:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6922300 going to sleep for 11 seconds 00000100:00100000:3.0:1788837925.463175:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037051904 00000100:00100000:3.0:1788837925.463180:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037051904 00000100:00100000:3.0:1788837925.463412:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788837925.463422:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+22:17197:x1875732037051904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837925.463433:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837925.463447:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afbea6a00/0x57f6d4e926af0678 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af0671 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837925.463470:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afbea6a00/0x57f6d4e926af0678 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af0671 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837925.463481:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afbea6a00/0x57f6d4e926af0678 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af0671 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837925.463489:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea6a00, rc 0) 00000100:00100000:3.0:1788837925.463536:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:17197:x1875732037051904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837925.463543:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788837925.463612:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037051904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837925.463626:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837925.463647:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837925.468225:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037052032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837925.468310:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.470294:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6922300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837925.472897:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037052032 00000100:00100000:2.0:1788837925.474307:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037052032 00000100:00100000:2.0:1788837925.474365:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788837925.474376:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:17197:x1875732037052032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837925.474540:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:17197:x1875732037052032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (6229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837925.474548:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788837925.474650:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037052032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837925.474707:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037052160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837925.474760:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837925.474813:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac6922300 going to sleep for 11 seconds 00000100:00100000:2.0:1788837925.474859:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037052160 00000100:00100000:2.0:1788837925.474863:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037052160 00000100:00100000:2.0:1788837925.474881:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788837925.474887:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:17197:x1875732037052160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837925.475051:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:17197:x1875732037052160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837925.475058:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788837925.475130:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3344000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037052160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788837925.478606:0:20284:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788837925.478672:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788837925.478695:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837925.478707:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837925.478720:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6c9400/0x57f6d4e926af0671 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0678 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837925.478732:0:17197:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788837925.478735:0:17197:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889ac409c800 from 13 10000000:01000000:2.0:1788837925.478737:0:17197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837925.478800:0:17197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837925.478809:0:17197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837925.478821:0:17197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837925.478847:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037052288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837925.480018:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837925.480067:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3748c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837925.480489:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037052288 00000100:00100000:3.0:1788837925.480500:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037052288 00000100:00100000:3.0:1788837925.480752:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788837925.480763:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+23:17197:x1875732037052288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837925.480798:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837925.480817:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afbea7200/0x57f6d4e926af0686 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x57f6d4e926af067f expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837925.480844:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afbea7200/0x57f6d4e926af0686 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x57f6d4e926af067f expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837925.480868:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afbea7200/0x57f6d4e926af0686 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x57f6d4e926af067f expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837925.480878:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea7200, rc 0) 00000100:00100000:1.0:1788837925.486453:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837925.491069:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:17197:x1875732037052288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 10295us (11042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837925.491084:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788837925.491138:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012852992 00000100:00100000:3.0:1788837925.491146:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012852992 00000100:00100000:3.0:1788837925.491181:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 161 00000100:00100000:3.0:1788837925.491191:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+12:14896:x1875732012852992:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837925.491353:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+12:14896:x1875732012852992:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 163us (4910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837925.491362:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 161 00000100:00100000:3.0:1788837925.491437:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037052288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837925.491459:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837925.491472:0:17197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837925.491559:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037052416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837925.491599:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837925.491630:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837925.492107:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037052416 00000100:00100000:3.0:1788837925.492119:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037052416 00000100:00100000:3.0:1788837925.492141:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788837925.492148:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:17197:x1875732037052416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837925.495395:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:17197:x1875732037052416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3238us (3787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837925.495410:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788837925.495480:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037052416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837925.495530:0:17197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037052544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837925.495577:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837925.495607:0:17197:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae7f4be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837925.495640:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037052544 00000100:00100000:3.0:1788837925.495646:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037052544 00000100:00100000:3.0:1788837925.495686:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788837925.495695:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:17197:x1875732037052544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837925.495837:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:17197:x1875732037052544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837925.495844:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788837925.495883:0:17197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d42f6ebb-a489-4c0b-be2b-e965e16a506d:17197:1875732037052544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837925.496699:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837925.499616:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012853120 00000100:00100000:3.0:1788837925.499629:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012853120 00000100:00100000:3.0:1788837925.499668:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 164 00000100:00100000:3.0:1788837925.499677:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+12:14896:x1875732012853120:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837925.499694:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837925.499709:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889afbea7600/0x57f6d4e926af068d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x857683b40003eeea expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837925.499747:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889afbea7600/0x57f6d4e926af068d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eeea expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837925.499758:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889afbea7600/0x57f6d4e926af068d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eeea expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837925.499768:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea7600, rc 0) 00000100:00100000:3.0:1788837925.499838:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:14896:x1875732012853120:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 162us (3143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837925.499846:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 164 00000040:00080000:3.0:1788837925.500612:0:20287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788837925.500666:0:17197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788837925.500686:0:17197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837925.500695:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837925.500704:0:17197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff889afa6da000/0x57f6d4e926af067f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x57f6d4e926af0686 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837925.505272:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837925.505310:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012853248 00000100:00100000:3.0:1788837925.505319:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012853248 00000100:00100000:3.0:1788837925.505369:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 165 00000100:00100000:3.0:1788837925.505378:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:14896:x1875732012853248:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837925.505520:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:14896:x1875732012853248:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 143us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837925.505543:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 165 00000100:00100000:1.0:1788837925.521079:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837925.521179:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012853376 00000100:00100000:0.0:1788837925.521190:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012853376 00000100:00100000:0.0:1788837925.521258:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 166 00000100:00100000:0.0:1788837925.521269:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:14896:x1875732012853376:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837925.521401:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:14896:x1875732012853376:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 133us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837925.521409:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 166 00000040:00080000:1.0:1788837925.627857:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788837925.823543:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c24e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037052672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837925.823619:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837925.823765:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037052672 00000100:00100000:3.0:1788837925.823795:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037052672 00000100:00100000:3.0:1788837925.823846:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788837925.823856:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037052672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837925.823891:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788837925.824013:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037052672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837925.824020:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788837925.824116:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c24e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037052672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837925.824135:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837925.824143:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037052800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837925.824168:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837925.824762:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037052800 00000100:00100000:3.0:1788837925.824769:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037052800 00000100:00100000:3.0:1788837925.824835:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788837925.824843:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037052800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788837925.824866:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788837925.825045:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875732037052800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 203us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837925.825052:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788837925.825362:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875732037052800:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788837926.208571:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837927.225859:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837927.414578:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837927.414616:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837927.414676:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837927.414696:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837927.414710:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837927.414723:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837927.414737:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837927.414762:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837927.414825:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837927.414850:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012854016 00000100:00100000:0.0:1788837927.414859:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012854016 00000100:00100000:0.0:1788837927.414917:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012854528 00000100:00100000:0.0:1788837927.414920:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012854528 00000100:00100000:0.0:1788837927.414933:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012853888 00000100:00100000:0.0:1788837927.414935:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012853888 00000100:00100000:0.0:1788837927.414947:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012854400 00000100:00100000:0.0:1788837927.414949:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012854400 00000100:00100000:0.0:1788837927.414963:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:0.0:1788837927.414972:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067bdd78-c556-4265-9b97-e4112a37245c+5:2396:x1875732012854016:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837927.415037:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067bdd78-c556-4265-9b97-e4112a37245c+5:2396:x1875732012854016:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 67us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837927.415044:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:0.0:1788837927.415058:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:0.0:1788837927.415063:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2396:x1875732012854528:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837927.415085:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2396:x1875732012854528:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 21us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837927.415091:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:0.0:1788837927.415101:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:0.0:1788837927.415106:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067bdd78-c556-4265-9b97-e4112a37245c+5:2396:x1875732012853888:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837927.415139:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067bdd78-c556-4265-9b97-e4112a37245c+5:2396:x1875732012853888:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 33us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837927.415146:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:0.0:1788837927.415159:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:0.0:1788837927.415165:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2396:x1875732012854400:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837927.415186:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2396:x1875732012854400:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 22us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837927.415192:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:3.0:1788837927.415544:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012853504 00000100:00100000:3.0:1788837927.415549:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012853504 00000100:00100000:2.0:1788837927.415549:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012853760 00000100:00100000:2.0:1788837927.415552:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012853760 00000100:00100000:2.0:1788837927.415577:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012854272 00000100:00100000:2.0:1788837927.415580:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012854272 00000100:00100000:2.0:1788837927.415593:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012853632 00000100:00100000:3.0:1788837927.415594:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 167 00000100:00100000:2.0:1788837927.415596:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012853632 00000100:00100000:3.0:1788837927.415601:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:2396:x1875732012853504:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837927.415606:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012854144 00000100:00100000:2.0:1788837927.415608:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012854144 00000100:00100000:2.0:1788837927.415621:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:3.0:1788837927.415627:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:2396:x1875732012853504:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 28us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837927.415627:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+5:2396:x1875732012853760:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837927.415633:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 167 00000100:00100000:3.0:1788837927.415663:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:2.0:1788837927.415665:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+5:2396:x1875732012853760:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 39us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837927.415672:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:3.0:1788837927.415676:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2396:x1875732012854272:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837927.415685:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:2.0:1788837927.415690:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+6:2396:x1875732012853632:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837927.415699:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2396:x1875732012854272:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 25us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837927.415705:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:2.0:1788837927.415708:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+6:2396:x1875732012853632:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 18us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837927.415714:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:3.0:1788837927.415717:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:3.0:1788837927.415722:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2396:x1875732012854144:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837927.415741:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2396:x1875732012854144:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 19us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837927.415747:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00080000:1.0:1788837927.416049:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837927.416054:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837927.416056:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837927.416058:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837928.099051:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837928.099158:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012854656 00000100:00100000:2.0:1788837928.099169:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012854656 00000100:00100000:2.0:1788837928.099274:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:2.0:1788837928.099285:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+6:15565:x1875732012854656:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837928.099306:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837928.099326:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0694 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eef1 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.099416:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af069b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.099443:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af069b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.099454:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af069b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.099469:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.099476:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.099482:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.099972:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926af06a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.099983:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926af06a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.099991:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926af06a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837928.100020:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788837928.100024:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788837928.100060:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926af06a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100071:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af069b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100087:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af069b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100094:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af069b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100100:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dbc00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837928.100104:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af069b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100111:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af069b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100123:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1ef00) 00010000:00010000:2.0:1788837928.100126:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837928.100131:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af069b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100136:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af069b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100150:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100156:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100161:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100166:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837928.100174:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100180:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100187:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff889af8e98700) 00010000:00010000:2.0:1788837928.100190:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837928.100192:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100198:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100243:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eef1 expref: 8 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100255:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6daa00/0x57f6d4e926af06a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eef1 expref: 7 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.100262:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff889af8e98f00) 00010000:00010000:2.0:1788837928.100264:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837928.100266:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6daa00, rc 0) 00000100:00100000:2.0:1788837928.100334:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+7:15565:x1875732012854656:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 1051us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837928.100341:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:1.0:1788837928.107083:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837928.107210:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012854784 00000100:00100000:0.0:1788837928.107220:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012854784 00000100:00100000:0.0:1788837928.107281:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:0.0:1788837928.107290:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:067bdd78-c556-4265-9b97-e4112a37245c+7:15565:x1875732012854784:12345-192.168.201.3@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788837928.107383:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:067bdd78-c556-4265-9b97-e4112a37245c+7:15565:x1875732012854784:12345-192.168.201.3@tcp:900:lhsmtool_posix.0 Request processed in 93us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.107391:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:0.0:1788837928.111544:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837928.124933:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012855040 00000100:00100000:2.0:1788837928.124948:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012855040 00000100:00100000:2.0:1788837928.125016:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:2.0:1788837928.125027:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+7:15565:x1875732012855040:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837928.125061:0:19205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837928.125081:0:19205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af06b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eef8 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.125153:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.125168:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.125178:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.125245:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.125252:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.125259:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.125353:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926af06c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.125372:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926af06c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.125379:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926af06c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837928.125387:0:19205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788837928.125535:0:19205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.125543:0:19205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.125549:0:19205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.125555:0:19205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837928.125559:0:19205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.125567:0:19205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.126659:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff889af8e98f00) 00010000:00010000:2.0:1788837928.126662:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837928.126667:0:19205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.126674:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.126687:0:19205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.126693:0:19205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.126699:0:19205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.126719:0:19205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dbc00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837928.126722:0:19205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.126729:0:19205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.126737:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff889af8e98700) 00010000:00010000:2.0:1788837928.126740:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837928.126742:0:19205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.126748:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.131321:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af06b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eef8 expref: 10 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.131350:0:19205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db400/0x57f6d4e926af06c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eef8 expref: 9 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.131370:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889af8e98900) 00010000:00010000:2.0:1788837928.131373:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837928.131376:0:19205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6db400, rc 0) 00000100:00100000:2.0:1788837928.131490:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+9:15565:x1875732012855040:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 6463us (19954us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788837928.131499:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:1.0:1788837928.149003:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837928.149088:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012855168 00000100:00100000:2.0:1788837928.149112:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012855168 00000100:00100000:2.0:1788837928.149170:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:2.0:1788837928.149180:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+9:15565:x1875732012855168:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788837928.149298:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+9:15565:x1875732012855168:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 Request processed in 119us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837928.149307:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:0.0:1788837928.164745:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837928.164925:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012855296 00000100:00100000:1.0:1788837928.164935:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012855296 00000100:00100000:1.0:1788837928.164999:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:1.0:1788837928.165008:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+5:15565:x1875732012855296:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788837928.167524:0:17202:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2464us 00000100:00100000:2.0:1788837928.210532:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+5:15565:x1875732012855296:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 Request processed in 45504us (45777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837928.210546:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:0.0:1788837928.219833:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837928.220509:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012855424 00000100:00100000:2.0:1788837928.220520:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012855424 00000100:00100000:2.0:1788837928.220591:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:2.0:1788837928.220601:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+9:15571:x1875732012855424:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837928.220620:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837928.220640:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af06d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003eeff expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.220702:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.220717:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.220730:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.220805:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.220827:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.220833:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221008:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221017:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221023:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221029:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dbc00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837928.221033:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221040:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221051:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1ef00) 00010000:00010000:2.0:1788837928.221054:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837928.221058:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221063:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af06da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221075:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221087:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221093:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221099:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837928.221102:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221108:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221117:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff889af8e98700) 00010000:00010000:2.0:1788837928.221120:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837928.221122:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221129:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af06e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221161:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af06d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eeff expref: 10 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221170:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1ef00) 00010000:00010000:2.0:1788837928.221173:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837928.221177:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af06d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eeff expref: 10 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.221198:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6dba00, rc 0) 00000100:00100000:2.0:1788837928.221306:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+9:15571:x1875732012855424:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 705us (1482us total) trans 0 rc 301/301 00000100:00100000:2.0:1788837928.221315:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:3.0:1788837928.226714:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837928.226847:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012855552 00000100:00100000:1.0:1788837928.226991:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012855552 00000100:00100000:1.0:1788837928.227045:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:1.0:1788837928.227055:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:067bdd78-c556-4265-9b97-e4112a37245c+9:15571:x1875732012855552:12345-192.168.201.3@tcp:700:lfs.0 00000100:00100000:1.0:1788837928.227133:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:067bdd78-c556-4265-9b97-e4112a37245c+9:15571:x1875732012855552:12345-192.168.201.3@tcp:700:lfs.0 Request processed in 80us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837928.227138:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:0.0:1788837928.229430:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837928.229499:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012855808 00000100:00100000:2.0:1788837928.229509:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012855808 00000100:00100000:2.0:1788837928.229573:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:2.0:1788837928.229584:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+9:15571:x1875732012855808:12345-192.168.201.3@tcp:36:lfs.0 00010000:00010000:2.0:1788837928.229637:0:19205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837928.229666:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6c9800/0x57f6d4e926af0601 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ee6c expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.229683:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1ef00) 00010000:00010000:2.0:1788837928.229688:0:19205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837928.229748:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.229763:0:19205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af0640 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003eedc expref: 5 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.229772:0:19205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.229836:0:19205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af0640 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eedc expref: 5 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.229851:0:19205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af0640 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eedc expref: 5 pid: 17201 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837928.229895:0:19205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19205:1875732037052928:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837928.229970:0:19205:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c37480c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837928.234424:0:19205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19205:1875732037052928:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837928.234453:0:19205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837928.239910:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837928.240151:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012855936 00000100:00100000:2.0:1788837928.240161:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012855936 00010000:00010000:2.0:1788837928.240210:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af0640 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eedc expref: 6 pid: 17201 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837928.240254:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:2.0:1788837928.240264:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2396:x1875732012855936:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837928.240279:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837928.240286:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af0640 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eedc expref: 6 pid: 17201 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.240300:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af0640 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eedc expref: 6 pid: 17201 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.240323:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af0640 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003eedc expref: 6 pid: 17201 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.240338:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1ef00) 00010000:00010000:2.0:1788837928.240343:0:17187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.240358:0:17187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.240367:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.240399:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837928.240449:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2396:x1875732012855936:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 186us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837928.240458:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 15 00010000:00010000:3.0:1788837928.240487:0:19205:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.240496:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.240522:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af06ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.240532:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af06ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.240540:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af06ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.246230:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af06f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.246257:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af06f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.246270:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af06f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837928.246288:0:19205:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adf3c40a reply state 00000000b1194da4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af06f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.246301:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af06f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.246307:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff889af8e98700) 00010000:00010000:2.0:1788837928.246310:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788837928.246314:0:19205:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788837928.246320:0:19205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788837928.246328:0:19205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.246346:0:19205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.246353:0:19205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.246358:0:19205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dae00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837928.246362:0:19205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.246369:0:19205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.246379:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1ef00) 00010000:00010000:2.0:1788837928.246381:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837928.246385:0:19205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.246390:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af06e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837928.246420:0:19205:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adf3c40a reply state 00000000b1194da4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af06ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.246430:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af06ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.246434:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff889b01a1f400) 00010000:00010000:2.0:1788837928.246435:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788837928.246437:0:19205:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788837928.246562:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+10:15571:x1875732012855808:12345-192.168.201.3@tcp:36:lfs.0 Request processed in 16977us (17139us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788837928.246580:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 28 00010000:00010000:3.0:1788837928.248982:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837928.354270:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837928.354837:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012856064 00000100:00100000:3.0:1788837928.354848:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012856064 00000100:00100000:3.0:1788837928.354930:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:3.0:1788837928.354960:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+10:15579:x1875732012856064:12345-192.168.201.3@tcp:101:lctl.0 00010000:00010000:3.0:1788837928.354990:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837928.355018:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af06fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef06 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.355086:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6c00/0x57f6d4e926af0704 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.355107:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6c00/0x57f6d4e926af0704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.355123:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6c00/0x57f6d4e926af0704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837928.355172:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788837928.355175:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837928.355234:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6c00/0x57f6d4e926af0704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.355261:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af06fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef06 expref: 12 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.355281:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6c00/0x57f6d4e926af0704 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef06 expref: 11 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.355290:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1fc00) 00010000:00010000:3.0:1788837928.355292:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837928.355296:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea6c00, rc 0) 00000100:00100000:3.0:1788837928.355364:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+11:15579:x1875732012856064:12345-192.168.201.3@tcp:101:lctl.0 Request processed in 412us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837928.355381:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:0.0:1788837928.388602:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837928.388835:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012856192 00000100:00100000:1.0:1788837928.388845:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012856192 00000100:00100000:1.0:1788837928.388909:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:1.0:1788837928.388919:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:15580:x1875732012856192:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788837928.388940:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837928.388961:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926af070b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef0d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837928.389026:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926af0712 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837928.389041:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926af0712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837928.389053:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926af0712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837928.389102:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788837928.389106:0:17202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788837928.389129:0:17202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926af0712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837928.389155:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926af070b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef0d expref: 7 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837928.389207:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a400/0x57f6d4e926af0712 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef0d expref: 6 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837928.389217:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1fc00) 00010000:00010000:1.0:1788837928.389220:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788837928.389223:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9a400, rc 0) 00000100:00100000:1.0:1788837928.389287:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:15580:x1875732012856192:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 369us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837928.389294:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:1.0:1788837928.398182:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837928.398275:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012856320 00000100:00100000:3.0:1788837928.398285:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012856320 00000100:00100000:3.0:1788837928.398350:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:3.0:1788837928.398360:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:15580:x1875732012856320:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788837928.398381:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837928.398411:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af0719 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef14 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.398471:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0720 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.398482:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.398491:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.398497:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0727 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.398501:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.398504:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.398938:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af072e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.398965:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af072e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.398972:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af072e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837928.399005:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788837928.399008:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837928.399022:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af072e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399030:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399035:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0720 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399039:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0720 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399042:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837928.399045:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0720 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399049:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0720 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399057:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1fc00) 00010000:00010000:3.0:1788837928.399059:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837928.399063:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0720 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399079:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0720 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399094:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399100:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0727 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399106:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0727 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399110:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837928.399113:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0727 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399119:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0727 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399126:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff889b01a1f400) 00010000:00010000:3.0:1788837928.399128:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837928.399132:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0727 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399138:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0727 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399163:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af0719 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef14 expref: 8 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399190:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af072e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef14 expref: 7 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.399207:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff889af8e98700) 00010000:00010000:3.0:1788837928.399210:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837928.399213:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea6600, rc 0) 00000100:00100000:3.0:1788837928.399259:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+7:15580:x1875732012856320:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 902us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837928.399264:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:0.0:1788837928.403342:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837928.403420:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012856448 00000100:00100000:3.0:1788837928.403428:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012856448 00000100:00100000:3.0:1788837928.403480:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:3.0:1788837928.403490:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:15580:x1875732012856448:12345-192.168.201.3@tcp:900:lfs.0 00000100:00100000:3.0:1788837928.403588:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:15580:x1875732012856448:12345-192.168.201.3@tcp:900:lfs.0 Request processed in 99us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837928.403596:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:0.0:1788837928.415507:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837928.415891:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012856704 00000100:00100000:1.0:1788837928.415902:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012856704 00000100:00100000:1.0:1788837928.416006:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:1.0:1788837928.416017:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cd2a6f9-4711-474b-ad66-0a44190716b9+7:15580:x1875732012856704:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788837928.416036:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837928.416058:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926af0735 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef1b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837928.416159:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788837928.416274:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926af0735 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef1b expref: 9 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837928.416289:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1fc00) 00010000:00010000:1.0:1788837928.416292:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788837928.416298:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8899c1a9a800/0x57f6d4e926af0735 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef1b expref: 9 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837928.416326:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8899c1a9a800, rc 0) 00000100:00100000:1.0:1788837928.416388:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cd2a6f9-4711-474b-ad66-0a44190716b9+8:15580:x1875732012856704:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 372us (890us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788837928.416396:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:1.0:1788837928.419749:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837928.419985:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012856960 00000100:00100000:2.0:1788837928.419994:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012856960 00000100:00100000:2.0:1788837928.420054:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:2.0:1788837928.420063:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+8:15580:x1875732012856960:12345-192.168.201.3@tcp:36:lfs.0 00010000:00010000:2.0:1788837928.420118:0:17201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837928.420143:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af072e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef14 expref: 8 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.420161:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff889af8e98700) 00010000:00010000:2.0:1788837928.420165:0:17201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837928.420187:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af0743 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.420216:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af0743 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.420226:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af0743 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837928.420457:0:17201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d3da2b1 reply state 0000000056b1c9e2 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af0743 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.420470:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af0743 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.420476:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff889af8e98700) 00010000:00010000:2.0:1788837928.420478:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788837928.420481:0:17201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788837928.420493:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788837928.421105:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+9:15580:x1875732012856960:12345-192.168.201.3@tcp:36:lfs.0 Request processed in 1038us (1363us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788837928.421114:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:0.0:1788837928.425057:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837928.425129:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012857216 00000100:00100000:1.0:1788837928.425140:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012857216 00000100:00100000:1.0:1788837928.425297:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:1.0:1788837928.425310:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+9:15580:x1875732012857216:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:1.0:1788837928.425543:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+10:15580:x1875732012857216:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 235us (783us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788837928.428528:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837928.428604:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012857472 00000100:00100000:3.0:1788837928.428613:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012857472 00000100:00100000:3.0:1788837928.428688:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:3.0:1788837928.428700:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+11:15580:x1875732012857472:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788837928.428728:0:19205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837928.428749:0:19205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af074a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef22 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.428889:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0751 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.428904:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0751 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.428916:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0751 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.428928:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0758 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.428935:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.428941:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837928.429046:0:19205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788837928.429133:0:19205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0751 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429143:0:19205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0751 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429150:0:19205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0751 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429155:0:19205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837928.429159:0:19205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0751 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429176:0:19205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0751 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429189:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1fc00) 00010000:00010000:3.0:1788837928.429192:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837928.429208:0:19205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0751 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429214:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0751 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429226:0:19205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0758 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429232:0:19205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0758 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429237:0:19205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0758 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429241:0:19205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837928.429244:0:19205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0758 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429250:0:19205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0758 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429258:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff889b01a1f400) 00010000:00010000:3.0:1788837928.429261:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837928.429264:0:19205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0758 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429279:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0758 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429314:0:19205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af074a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef22 expref: 13 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429324:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1fc00) 00010000:00010000:3.0:1788837928.429326:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788837928.429330:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af074a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef22 expref: 13 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.429338:0:19205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea6e00, rc 0) 00000100:00100000:3.0:1788837928.429400:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+12:15580:x1875732012857472:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 702us (883us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788837928.429408:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:1.0:1788837928.432560:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:3.0:1788837928.433487:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837928.433607:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012857600 00000100:00100000:0.0:1788837928.433617:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012857600 00000100:00100000:0.0:1788837928.433678:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:0.0:1788837928.433688:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+11:15580:x1875732012857600:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837928.433711:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837928.433732:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926af0766 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef29 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.434016:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17600/0x57f6d4e926af076d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.434031:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17600/0x57f6d4e926af076d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.434043:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17600/0x57f6d4e926af076d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837928.434069:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788837928.434072:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788837928.434092:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17600/0x57f6d4e926af076d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.434116:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16800/0x57f6d4e926af0766 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef29 expref: 13 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.434132:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17600/0x57f6d4e926af076d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef29 expref: 12 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.434141:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff889af8e98700) 00010000:00010000:0.0:1788837928.434158:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837928.434162:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17600, rc 0) 00000100:00100000:0.0:1788837928.434238:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+12:15580:x1875732012857600:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 550us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.434244:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:0.0:1788837928.439843:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837928.439978:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012857728 00000100:00100000:1.0:1788837928.439989:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012857728 00000100:00100000:1.0:1788837928.440046:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:1.0:1788837928.440056:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+12:15580:x1875732012857728:12345-192.168.201.3@tcp:37:lfs.0 00000100:00100000:1.0:1788837928.447081:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+12:15580:x1875732012857728:12345-192.168.201.3@tcp:37:lfs.0 Request processed in 7015us (7235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837928.447096:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:3.0:1788837928.450498:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837928.450975:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012857984 00000100:00100000:0.0:1788837928.450986:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012857984 00000100:00100000:0.0:1788837928.451043:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:0.0:1788837928.451053:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c269e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+12:15580:x1875732012857984:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:0.0:1788837928.451291:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c269e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cd2a6f9-4711-474b-ad66-0a44190716b9+13:15580:x1875732012857984:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 238us (803us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788837928.451299:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:0.0:1788837928.521512:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837928.522011:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012858112 00000100:00100000:3.0:1788837928.522048:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012858112 00000100:00100000:3.0:1788837928.522111:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:3.0:1788837928.522121:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+11:15586:x1875732012858112:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788837928.522139:0:19205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837928.522157:0:19205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7000/0x57f6d4e926af0774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef30 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.522259:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af077b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.522296:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af077b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.522306:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af077b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.522317:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0782 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.522325:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.522331:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523004:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0789 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523015:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0789 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523023:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0789 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837928.523057:0:19205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788837928.523061:0:19205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837928.523097:0:19205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0789 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523109:0:19205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af077b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523126:0:19205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af077b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523133:0:19205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af077b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523138:0:19205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837928.523142:0:19205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af077b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523150:0:19205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af077b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523162:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1fc00) 00010000:00010000:3.0:1788837928.523165:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837928.523169:0:19205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af077b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523175:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af077b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523188:0:19205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523194:0:19205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0782 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523454:0:19205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523460:0:19205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837928.523469:0:19205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523476:0:19205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0782 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523484:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff889b01a1f400) 00010000:00010000:3.0:1788837928.523487:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837928.523490:0:19205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0782 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523496:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af0782 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523945:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7000/0x57f6d4e926af0774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef30 expref: 13 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523962:0:19205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7800/0x57f6d4e926af0789 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef30 expref: 12 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.523968:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff889af8e98700) 00010000:00010000:3.0:1788837928.523970:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788837928.523973:0:19205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea7800, rc 0) 00000100:00100000:3.0:1788837928.524048:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+12:15586:x1875732012858112:12345-192.168.201.3@tcp:101:bash.0 Request processed in 1927us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837928.524056:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:3.0:1788837928.527005:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837928.532556:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012858240 00000100:00100000:0.0:1788837928.532573:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012858240 00000100:00100000:0.0:1788837928.532651:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:0.0:1788837928.532661:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:067bdd78-c556-4265-9b97-e4112a37245c+5:15586:x1875732012858240:12345-192.168.201.3@tcp:900:bash.0 00000100:00100000:0.0:1788837928.532752:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:067bdd78-c556-4265-9b97-e4112a37245c+5:15586:x1875732012858240:12345-192.168.201.3@tcp:900:bash.0 Request processed in 91us (5754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.532760:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:1.0:1788837928.543328:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837928.543425:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012858496 00000100:00100000:2.0:1788837928.543435:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012858496 00000100:00100000:2.0:1788837928.543498:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 37 00000100:00100000:2.0:1788837928.543508:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+12:15586:x1875732012858496:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788837928.543527:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837928.543548:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0790 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef37 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.543662:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.543679:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17600/0x57f6d4e926af076d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef29 expref: 12 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.543687:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.543721:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17600/0x57f6d4e926af076d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef29 expref: 12 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.543733:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17600/0x57f6d4e926af076d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef29 expref: 12 pid: 17200 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837928.543747:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17201:1875732037053056:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837928.545256:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3748c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788837928.548237:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837928.554486:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17201:1875732037053056:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837928.554522:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837928.555217:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012858624 00000100:00100000:3.0:1788837928.555226:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012858624 00010000:00010000:3.0:1788837928.555270:0:20228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17600/0x57f6d4e926af076d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef29 expref: 13 pid: 17200 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837928.555331:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788837928.555342:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+13:2395:x1875732012858624:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837928.555361:0:20228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837928.555368:0:20228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17600/0x57f6d4e926af076d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef29 expref: 13 pid: 17200 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.555381:0:20228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17600/0x57f6d4e926af076d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef29 expref: 13 pid: 17200 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.555404:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17600/0x57f6d4e926af076d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef29 expref: 13 pid: 17200 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.555421:0:20228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff889af8e98700) 00010000:00010000:3.0:1788837928.555426:0:20228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.555437:0:20228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.555445:0:20228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.555475:0:20228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837928.555543:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+12:2395:x1875732012858624:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 203us (7315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837928.555551:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00010000:00010000:2.0:1788837928.555832:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.555841:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.555892:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af079e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.555903:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af079e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.555912:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af079e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.556378:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af07a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.556387:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af07a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.556393:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af07a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837928.556403:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788837928.556427:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.556434:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.556450:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.556455:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db800 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837928.556459:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.556466:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.556475:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff889af8e98700) 00010000:00010000:2.0:1788837928.556478:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837928.556482:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.556488:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0797 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837928.556500:0:17201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8f58621 reply state 000000006261fde6 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af079e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.556509:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af079e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.556515:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff889af8e98300) 00010000:00010000:2.0:1788837928.556517:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788837928.556519:0:17201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788837928.556552:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0790 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef37 expref: 15 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.556566:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af07a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef37 expref: 14 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.556580:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:2.0:1788837928.556583:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788837928.556585:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6da400, rc 0) 00000100:00100000:2.0:1788837928.556629:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+15:15586:x1875732012858496:12345-192.168.201.3@tcp:101:bash.0 Request processed in 13123us (13313us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788837928.556637:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 37 00000100:00100000:1.0:1788837928.571930:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837928.572070:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012858752 00000100:00100000:0.0:1788837928.572080:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012858752 00000100:00100000:0.0:1788837928.572144:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:0.0:1788837928.572154:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+15:15586:x1875732012858752:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:0.0:1788837928.572178:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837928.572223:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef3e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.572294:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16000/0x57f6d4e926af07ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.572308:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16000/0x57f6d4e926af07ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.572320:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16000/0x57f6d4e926af07ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837928.572372:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788837928.572376:0:17202:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788837928.572404:0:17202:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16000/0x57f6d4e926af07ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.572415:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16000/0x57f6d4e926af07ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.572439:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef3e expref: 17 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.572457:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16000/0x57f6d4e926af07ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef3e expref: 16 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.572465:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:0.0:1788837928.572468:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788837928.572471:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16000, rc 0) 00000100:00100000:0.0:1788837928.572535:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+16:15586:x1875732012858752:12345-192.168.201.3@tcp:101:bash.0 Request processed in 382us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.572552:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:3.0:1788837928.576871:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837928.583745:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012859008 00000100:00100000:1.0:1788837928.583759:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012859008 00000100:00100000:1.0:1788837928.583958:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:1.0:1788837928.583983:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067bdd78-c556-4265-9b97-e4112a37245c+16:15586:x1875732012859008:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:1.0:1788837928.584252:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067bdd78-c556-4265-9b97-e4112a37245c+17:15586:x1875732012859008:12345-192.168.201.3@tcp:35:bash.0 Request processed in 269us (7446us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788837928.584260:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00000040:00080000:1.0:1788837928.697838:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788837928.719835:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837928.720020:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012859264 00000100:00100000:0.0:1788837928.720030:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012859264 00000100:00100000:0.0:1788837928.720100:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:0.0:1788837928.720111:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+17:15596:x1875732012859264:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788837928.720137:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837928.720157:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef45 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837928.720292:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788837928.720388:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef45 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.720402:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff889b01a1fc00) 00010000:00010000:0.0:1788837928.720406:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837928.720411:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef45 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.720422:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17e00, rc 0) 00000100:00100000:0.0:1788837928.720486:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+18:15596:x1875732012859264:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 376us (662us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788837928.720493:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:0.0:1788837928.726898:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837928.726962:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012859520 00000100:00100000:1.0:1788837928.726971:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012859520 00000100:00100000:1.0:1788837928.727018:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:1.0:1788837928.727025:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067bdd78-c556-4265-9b97-e4112a37245c+18:15596:x1875732012859520:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:1.0:1788837928.727229:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067bdd78-c556-4265-9b97-e4112a37245c+19:15596:x1875732012859520:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 203us (340us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788837928.727237:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:3.0:1788837928.807760:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837928.808135:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012859776 00000100:00100000:2.0:1788837928.808145:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012859776 00000100:00100000:2.0:1788837928.808239:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:2.0:1788837928.808248:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+19:15599:x1875732012859776:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788837928.808273:0:19205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837928.808293:0:19205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af07cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef4c expref: -99 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.808389:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af07d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.808403:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af07d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.808413:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af07d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837928.808423:0:19205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788837928.808537:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af07cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef4c expref: 22 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.808579:0:19205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af07d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef4c expref: 21 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.808589:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:2.0:1788837928.808592:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837928.808596:0:19205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6db800, rc 0) 00000100:00100000:2.0:1788837928.808665:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+21:15599:x1875732012859776:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 418us (916us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788837928.808673:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:3.0:1788837928.812636:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837928.813509:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012859904 00000100:00100000:0.0:1788837928.813519:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012859904 00000100:00100000:0.0:1788837928.813733:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:0.0:1788837928.813745:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+21:15599:x1875732012859904:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:0.0:1788837928.813941:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.813959:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.813970:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.814002:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.814010:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.814017:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.814023:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837928.814027:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.814034:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.814043:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:0.0:1788837928.814046:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837928.814050:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07e4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.814056:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17e00/0x57f6d4e926af07e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837928.814144:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+21:15599:x1875732012859904:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 402us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.814151:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:1.0:1788837928.816630:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837928.816863:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012860032 00000100:00100000:3.0:1788837928.816873:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012860032 00000100:00100000:3.0:1788837928.816943:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:3.0:1788837928.816954:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067bdd78-c556-4265-9b97-e4112a37245c+21:2395:x1875732012860032:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837928.816970:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837928.816995:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af07d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef4c expref: 21 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.817014:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:3.0:1788837928.817018:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837928.817076:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067bdd78-c556-4265-9b97-e4112a37245c+20:2395:x1875732012860032:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 123us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837928.817085:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:3.0:1788837928.819096:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837928.819180:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012860288 00000100:00100000:1.0:1788837928.819207:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012860288 00000100:00100000:1.0:1788837928.819263:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:1.0:1788837928.819275:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067bdd78-c556-4265-9b97-e4112a37245c+20:15599:x1875732012860288:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:1.0:1788837928.819505:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067bdd78-c556-4265-9b97-e4112a37245c+21:15599:x1875732012860288:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 231us (416us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788837928.819512:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000040:00080000:3.0:1788837928.826490:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788837929.193139:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837929.193241:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012860544 00000100:00100000:2.0:1788837929.193252:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012860544 00000100:00100000:2.0:1788837929.193328:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:2.0:1788837929.193339:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+21:15630:x1875732012860544:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:2.0:1788837929.193363:0:19205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837929.193385:0:19205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af07eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef53 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.193507:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af07f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.193523:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af07f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.193538:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af07f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837929.193551:0:19205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788837929.193681:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af07eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef53 expref: 24 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.193699:0:19205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af07f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef53 expref: 23 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.193706:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:2.0:1788837929.193718:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837929.193721:0:19205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6da200, rc 0) 00000100:00100000:2.0:1788837929.193818:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+23:15630:x1875732012860544:12345-192.168.201.3@tcp:101:cat.0 Request processed in 480us (688us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788837929.193825:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00080000:1.0:1788837929.194563:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837929.202239:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837929.202387:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012860672 00000100:00100000:3.0:1788837929.202396:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012860672 00000100:00100000:3.0:1788837929.202472:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:3.0:1788837929.202482:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067bdd78-c556-4265-9b97-e4112a37245c+23:2396:x1875732012860672:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837929.202498:0:20228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837929.202522:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af07f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef53 expref: 23 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.202541:0:20228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:3.0:1788837929.202545:0:20228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837929.202617:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067bdd78-c556-4265-9b97-e4112a37245c+22:2396:x1875732012860672:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 136us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837929.202626:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:3.0:1788837929.203729:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837929.203805:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012860928 00000100:00100000:1.0:1788837929.203811:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012860928 00000100:00100000:1.0:1788837929.203850:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:1.0:1788837929.203859:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067bdd78-c556-4265-9b97-e4112a37245c+22:15630:x1875732012860928:12345-192.168.201.3@tcp:35:cat.0 00000100:00100000:1.0:1788837929.204133:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067bdd78-c556-4265-9b97-e4112a37245c+23:15630:x1875732012860928:12345-192.168.201.3@tcp:35:cat.0 Request processed in 273us (407us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788837929.204150:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00010000:00010000:2.0:1788837929.274097:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837929.294531:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837929.294675:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012861184 00000100:00100000:2.0:1788837929.294684:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012861184 00000100:00100000:2.0:1788837929.294760:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:2.0:1788837929.294769:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+23:15636:x1875732012861184:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:2.0:1788837929.295003:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837929.295025:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da800/0x57f6d4e926af0800 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef5a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.295134:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0807 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.295156:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af07a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef37 expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.295162:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16000/0x57f6d4e926af07ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef3e expref: 24 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.295189:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0807 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.295217:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16000/0x57f6d4e926af07ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef3e expref: 24 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.295227:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16000/0x57f6d4e926af07ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef3e expref: 24 pid: 17202 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837929.295237:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17201:1875732037053184:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788837929.295312:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af07a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef37 expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.295318:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af07a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef37 expref: 24 pid: 17201 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837929.295324:0:17201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17201:1875732037053312:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837929.295337:0:17201:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3748240 going to sleep for 11 seconds 00000100:00100000:2.0:1788837929.299726:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837929.299768:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837929.300020:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17201:1875732037053184:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788837929.300033:0:17201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17201:1875732037053312:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837929.300060:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0807 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837929.300354:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012861440 00000100:00100000:1.0:1788837929.300361:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012861440 00010000:00010000:1.0:1788837929.300512:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af07a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef37 expref: 25 pid: 17201 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837929.300588:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012861312 00000100:00100000:1.0:1788837929.300593:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012861312 00010000:00010000:1.0:1788837929.300607:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16000/0x57f6d4e926af07ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef3e expref: 26 pid: 17202 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837929.300648:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:1.0:1788837929.300657:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067bdd78-c556-4265-9b97-e4112a37245c+26:2396:x1875732012861440:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837929.300671:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837929.300677:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af07a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef37 expref: 26 pid: 17201 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837929.300686:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af07a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef37 expref: 26 pid: 17201 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837929.300707:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af07a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef37 expref: 26 pid: 17201 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837929.300722:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:1.0:1788837929.300727:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0807 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837929.300749:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0807 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837929.300755:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837929.300844:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067bdd78-c556-4265-9b97-e4112a37245c+25:2396:x1875732012861440:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 188us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837929.300853:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:1.0:1788837929.300870:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:1.0:1788837929.300877:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889afc3b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067bdd78-c556-4265-9b97-e4112a37245c+24:2396:x1875732012861312:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837929.300885:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837929.300890:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16000/0x57f6d4e926af07ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef3e expref: 24 pid: 17202 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837929.300900:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16000/0x57f6d4e926af07ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef3e expref: 24 pid: 17202 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837929.300913:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16000/0x57f6d4e926af07ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef3e expref: 24 pid: 17202 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837929.300924:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:1.0:1788837929.300928:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0807 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837929.300936:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0807 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837929.300943:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0807 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837929.300972:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837929.300992:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889afc3b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067bdd78-c556-4265-9b97-e4112a37245c+23:2396:x1875732012861312:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 116us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837929.300998:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00010000:00010000:2.0:1788837929.301609:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0807 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.301631:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0807 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837929.301652:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788837929.301862:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da800/0x57f6d4e926af0800 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef5a expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.301880:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dba00/0x57f6d4e926af0807 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef5a expref: 23 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.301889:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:2.0:1788837929.301891:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788837929.301894:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6dba00, rc 0) 00000100:00100000:2.0:1788837929.301943:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+23:15636:x1875732012861184:12345-192.168.201.3@tcp:101:dd.0 Request processed in 7174us (7420us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788837929.301951:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:2.0:1788837929.311108:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837929.311175:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012861568 00000100:00100000:3.0:1788837929.311193:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012861568 00000100:00100000:3.0:1788837929.311252:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:3.0:1788837929.311260:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+23:15636:x1875732012861568:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:3.0:1788837929.311281:0:19205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837929.311299:0:19205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7000/0x57f6d4e926af0815 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef61 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.311327:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af081c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.311338:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af081c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.311349:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af081c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.311564:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7000/0x57f6d4e926af0815 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef61 expref: 25 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.311587:0:19205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af081c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef61 expref: 24 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.311593:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:3.0:1788837929.311595:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788837929.311598:0:19205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea6200, rc 0) 00000100:00100000:3.0:1788837929.311697:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+24:15636:x1875732012861568:12345-192.168.201.3@tcp:101:dd.0 Request processed in 437us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837929.311701:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:1.0:1788837929.314196:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837929.314333:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012861824 00000100:00100000:0.0:1788837929.314344:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012861824 00000100:00100000:0.0:1788837929.314409:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:0.0:1788837929.314419:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+24:15636:x1875732012861824:12345-192.168.201.3@tcp:36:dd.0 00010000:00010000:0.0:1788837929.314746:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17000/0x57f6d4e926af0823 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.314765:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17000/0x57f6d4e926af0823 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.314860:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17000/0x57f6d4e926af0823 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837929.314908:0:17200:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788837929.314934:0:17200:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026ca13c9 reply state 00000000b3f04cd7 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17000/0x57f6d4e926af0823 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.314946:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17000/0x57f6d4e926af0823 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.314954:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:0.0:1788837929.314957:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788837929.314961:0:17200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788837929.315105:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+27:15636:x1875732012861824:12345-192.168.201.3@tcp:36:dd.0 Request processed in 684us (923us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788837929.315127:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 45 00000020:00080000:0.0:1788837929.315133:0:17200:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788837929.317294:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837929.317452:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012861952 00000100:00100000:0.0:1788837929.317463:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012861952 00000100:00100000:0.0:1788837929.317557:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:0.0:1788837929.317569:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+27:15636:x1875732012861952:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:0.0:1788837929.317594:0:17202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837929.317627:0:17202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17200/0x57f6d4e926af082a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef68 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.317683:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17200/0x57f6d4e926af082a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef68 expref: 28 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.317696:0:17202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17200/0x57f6d4e926af082a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef68 expref: 28 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.317714:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:0.0:1788837929.317716:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837929.317720:0:17202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17200, rc 0) 00000100:00100000:0.0:1788837929.317809:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+28:15636:x1875732012861952:12345-192.168.201.3@tcp:101:dd.0 Request processed in 241us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837929.317816:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:2.0:1788837929.342337:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837929.342495:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012862208 00000100:00100000:1.0:1788837929.342505:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012862208 00000100:00100000:1.0:1788837929.342571:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:1.0:1788837929.342581:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067bdd78-c556-4265-9b97-e4112a37245c+28:15636:x1875732012862208:12345-192.168.201.3@tcp:103:dd.0 00010000:00010000:1.0:1788837929.342596:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837929.342630:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17200/0x57f6d4e926af082a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef68 expref: 28 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837929.342650:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:1.0:1788837929.342656:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837929.342715:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067bdd78-c556-4265-9b97-e4112a37245c+27:15636:x1875732012862208:12345-192.168.201.3@tcp:103:dd.0 Request processed in 136us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837929.342723:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:1.0:1788837929.344904:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837929.344988:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012862336 00000100:00100000:2.0:1788837929.344997:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012862336 00000100:00100000:2.0:1788837929.345059:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:2.0:1788837929.345069:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c24e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+27:15636:x1875732012862336:12345-192.168.201.3@tcp:58:dd.0 00010000:00010000:2.0:1788837929.345191:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af0831 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.345209:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af0831 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.345221:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af0831 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837929.347518:0:17201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788837929.347971:0:17201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788837929.348136:0:17201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788837929.349088:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c24e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+27:15636:x1875732012862336:12345-192.168.201.3@tcp:58:dd.0 Request processed in 4012us (4184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837929.349102:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:0.0:1788837929.353725:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837929.354135:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012862464 00000100:00100000:3.0:1788837929.354156:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012862464 00000100:00100000:3.0:1788837929.354228:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 48 00000100:00100000:3.0:1788837929.354239:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c44cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+27:15636:x1875732012862464:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:3.0:1788837929.354261:0:19205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837929.354281:0:19205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7000/0x57f6d4e926af0838 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef6f expref: -99 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.354335:0:19205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af0831 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.354355:0:19205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7000/0x57f6d4e926af0838 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef6f expref: 28 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.354375:0:19205:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af0831 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.354389:0:19205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7000/0x57f6d4e926af0838 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef6f expref: 28 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.354419:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:3.0:1788837929.354422:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788837929.354427:0:19205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7000/0x57f6d4e926af0838 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef6f expref: 28 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.354434:0:19205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea7000, rc 0) 00000100:00100000:3.0:1788837929.354505:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c44cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+28:15636:x1875732012862464:12345-192.168.201.3@tcp:101:dd.0 Request processed in 268us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837929.354512:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 48 00000100:00100000:0.0:1788837929.402014:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837929.402041:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037053440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837929.402111:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837929.402356:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037053440 00000100:00100000:1.0:1788837929.402365:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037053440 00000100:00100000:1.0:1788837929.402433:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788837929.402444:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037053440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788837929.402471:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788837929.402526:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037053440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837929.402539:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788837929.402665:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037053440:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788837929.402721:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788837929.721338:0:17236:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788837929.721348:0:17236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837929.721398:0:17236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788837929.721408:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788837929.721541:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d40a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17236:1875732037053568:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788837929.721823:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ac69229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837929.724394:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d40a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17236:1875732037053568:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788837929.736268:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837929.738470:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012862592 00000100:00100000:0.0:1788837929.738484:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012862592 00000100:00100000:0.0:1788837929.738557:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 49 00000100:00100000:0.0:1788837929.738566:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+28:15637:x1875732012862592:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788837929.738595:0:17200:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788837929.738731:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+28:15637:x1875732012862592:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 165us (2476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837929.738739:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 49 00000100:00100000:0.0:1788837929.749495:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837929.749728:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012862720 00000100:00100000:3.0:1788837929.749738:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012862720 00000100:00100000:3.0:1788837929.749829:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:3.0:1788837929.749840:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+28:15637:x1875732012862720:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788837929.749923:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af083f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.749941:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af083f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.749953:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af083f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750019:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af0846 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750027:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af0846 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750050:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af0846 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750074:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af084d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750082:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af084d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750088:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af084d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837929.750133:0:19205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788837929.750137:0:19205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837929.750152:0:19205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af084d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750161:0:19205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af083f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750167:0:19205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af083f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750185:0:19205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af083f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750192:0:19205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6e00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837929.750370:0:19205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af083f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750452:0:19205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af083f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750471:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889af8e98900) 00010000:00010000:3.0:1788837929.750474:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837929.750478:0:19205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af083f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750484:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6e00/0x57f6d4e926af083f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750498:0:19205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af0846 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750504:0:19205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af0846 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750510:0:19205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af0846 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750514:0:19205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea6600 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837929.750516:0:19205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af0846 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750522:0:19205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af0846 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750530:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff889b01a1f700) 00010000:00010000:3.0:1788837929.750532:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837929.750535:0:19205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af0846 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750540:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6600/0x57f6d4e926af0846 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750568:0:19205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af084d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750574:0:19205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af084d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750580:0:19205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af084d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750585:0:19205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac6000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:3.0:1788837929.750588:0:19205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af084d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750593:0:19205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af084d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.750600:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:3.0:1788837929.750603:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837929.751296:0:19205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af084d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.751308:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af084d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837929.751576:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+28:15637:x1875732012862720:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 Request processed in 1734us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837929.751587:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:3.0:1788837929.755417:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837929.755520:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012862976 00000100:00100000:0.0:1788837929.755531:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012862976 00000100:00100000:0.0:1788837929.755602:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:0.0:1788837929.755625:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+28:15637:x1875732012862976:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837929.755650:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837929.755671:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16400/0x57f6d4e926af0854 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef76 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.755811:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af085b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.755827:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af085b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.755839:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af085b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837929.755850:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788837929.755948:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af085b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.755956:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af085b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.755962:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af085b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.755968:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837929.755973:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af085b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.755980:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af085b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.755994:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:0.0:1788837929.755997:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788837929.756001:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af085b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.756008:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af085b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.756053:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16400/0x57f6d4e926af0854 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef76 expref: 30 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.756064:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff889af8e98900) 00010000:00010000:0.0:1788837929.756066:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837929.756070:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16400/0x57f6d4e926af0854 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef76 expref: 30 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.756092:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b16400, rc 0) 00000100:00100000:0.0:1788837929.756164:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+29:15637:x1875732012862976:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 552us (758us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788837929.756172:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:1.0:1788837929.766567:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837929.766649:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012863104 00000100:00100000:0.0:1788837929.766662:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012863104 00000100:00100000:0.0:1788837929.766734:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:0.0:1788837929.766745:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+29:15637:x1875732012863104:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788837929.766800:0:17202:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788837929.767054:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+29:15637:x1875732012863104:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 311us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837929.767062:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:1.0:1788837929.774446:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837929.775638:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012863360 00000100:00100000:2.0:1788837929.775651:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012863360 00000100:00100000:2.0:1788837929.775723:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:2.0:1788837929.775734:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+29:15637:x1875732012863360:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837929.775755:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837929.775804:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0869 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef7d expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837929.776172:0:17201:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:2.0:1788837929.776201:0:17201:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788837929.776222:0:17201:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788837929.776369:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbe00/0x57f6d4e926af0870 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.776399:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbe00/0x57f6d4e926af0870 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.776410:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbe00/0x57f6d4e926af0870 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.776464:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af0869 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef7d expref: 32 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.776496:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbe00/0x57f6d4e926af0870 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef7d expref: 31 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.776505:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff889af8e98c00) 00010000:00010000:2.0:1788837929.776508:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788837929.776511:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6dbe00, rc 0) 00000100:00100000:2.0:1788837929.776571:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+31:15637:x1875732012863360:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 839us (2146us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788837929.776578:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:2.0:1788837929.788223:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837929.788411:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012863616 00000100:00100000:0.0:1788837929.788475:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012863616 00000100:00100000:0.0:1788837929.788542:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:0.0:1788837929.788553:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+31:15637:x1875732012863616:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788837929.788678:0:17202:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837929.788707:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbe00/0x57f6d4e926af0870 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef7d expref: 31 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.788726:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff889af8e98c00) 00010000:00010000:0.0:1788837929.788736:0:17202:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837929.788759:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16400/0x57f6d4e926af087e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789158:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16400/0x57f6d4e926af087e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789168:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16400/0x57f6d4e926af087e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789241:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af0885 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6df95a9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789250:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af0885 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6df95a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789256:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af0885 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6df95a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789304:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16400/0x57f6d4e926af087e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789312:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16400/0x57f6d4e926af087e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789318:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16400/0x57f6d4e926af087e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789324:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837929.789328:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16400/0x57f6d4e926af087e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789335:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16400/0x57f6d4e926af087e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789344:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff889af8e98700) 00010000:00010000:0.0:1788837929.789353:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837929.789358:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16400/0x57f6d4e926af087e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789364:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16400/0x57f6d4e926af087e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789388:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af0885 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6df95a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789394:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af0885 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6df95a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789400:0:17202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af0885 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6df95a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789406:0:17202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837929.789409:0:17202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af0885 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6df95a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789415:0:17202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af0885 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6df95a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789422:0:17202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6df95a9d (ffff8899c255d900) 00010000:00010000:0.0:1788837929.789642:0:17202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837929.789647:0:17202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af0885 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6df95a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.789654:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b16a00/0x57f6d4e926af0885 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6df95a9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837929.789813:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067bdd78-c556-4265-9b97-e4112a37245c+30:15637:x1875732012863616:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 1259us (1600us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788837929.789827:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:0.0:1788837929.803833:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837929.803922:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012863744 00000100:00100000:2.0:1788837929.803932:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012863744 00000100:00100000:2.0:1788837929.803995:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:2.0:1788837929.804005:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+30:15637:x1875732012863744:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837929.804025:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837929.804045:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af088c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef84 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.804079:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da800/0x57f6d4e926af0893 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.804092:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da800/0x57f6d4e926af0893 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.804103:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da800/0x57f6d4e926af0893 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.804234:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af088c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef84 expref: 32 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.804252:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da800/0x57f6d4e926af0893 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef84 expref: 31 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.804260:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff889af8e98100) 00010000:00010000:2.0:1788837929.804263:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788837929.804266:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6da800, rc 0) 00000100:00100000:2.0:1788837929.804331:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+31:15637:x1875732012863744:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 327us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837929.804338:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:1.0:1788837929.824888:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837929.825122:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012864000 00000100:00100000:3.0:1788837929.825133:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012864000 00000100:00100000:3.0:1788837929.825203:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:3.0:1788837929.825215:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+31:15637:x1875732012864000:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788837929.825298:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af089a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.825328:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af089a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.825340:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af089a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788837929.825527:0:19205:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1788837929.825537:0:19205:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 546696760386ns, next at 547696757804ns, rc = 0 00000004:00010000:3.0:1788837929.825581:0:19205:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0489407 reply state 0000000055c8b0dc transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af089a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.825595:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af089a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.825602:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff889af8e98100) 00010000:00010000:3.0:1788837929.825605:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788837929.825608:0:19205:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837929.825713:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+33:15637:x1875732012864000:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 499us (834us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788837929.825721:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:0.0:1788837929.835584:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837929.836847:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012864128 00000100:00100000:2.0:1788837929.836874:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012864128 00000100:00100000:2.0:1788837929.836951:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:2.0:1788837929.836962:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+33:15637:x1875732012864128:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837929.836991:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837929.837013:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af08a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef8b expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.837079:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af08a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef8b expref: 34 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.837095:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af08a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef8b expref: 34 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.837137:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff889af8e98100) 00010000:00010000:2.0:1788837929.837141:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837929.837145:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6db800, rc 0) 00000100:00100000:2.0:1788837929.837229:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+34:15637:x1875732012864128:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 268us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837929.837237:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:1.0:1788837929.850324:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837929.850422:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012864256 00000100:00100000:0.0:1788837929.850441:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012864256 00000100:00100000:0.0:1788837929.850520:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:0.0:1788837929.850531:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067bdd78-c556-4265-9b97-e4112a37245c+5:2395:x1875732012864256:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788837929.851103:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837929.851422:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067bdd78-c556-4265-9b97-e4112a37245c+6:2395:x1875732012864256:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 890us (1104us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788837929.851440:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:1.0:1788837929.871675:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837929.882797:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012864512 00000100:00100000:0.0:1788837929.882812:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012864512 00000100:00100000:0.0:1788837929.882896:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:0.0:1788837929.882907:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067bdd78-c556-4265-9b97-e4112a37245c+34:15637:x1875732012864512:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788837929.883143:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067bdd78-c556-4265-9b97-e4112a37245c+35:15637:x1875732012864512:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 237us (11772us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788837929.883152:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:2.0:1788837929.886823:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837929.887706:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012864768 00000100:00100000:3.0:1788837929.887718:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012864768 00000100:00100000:3.0:1788837929.887805:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:3.0:1788837929.887816:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+35:15637:x1875732012864768:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788837929.887946:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+35:15637:x1875732012864768:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 131us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837929.887954:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:1.0:1788837929.897390:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837929.897621:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012864896 00000100:00100000:2.0:1788837929.897632:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012864896 00000100:00100000:2.0:1788837929.897692:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:2.0:1788837929.897702:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+35:15637:x1875732012864896:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788837929.897721:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837929.897742:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af08a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef92 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.897852:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbe00/0x57f6d4e926af08af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.897877:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbe00/0x57f6d4e926af08af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.897889:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbe00/0x57f6d4e926af08af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837929.897931:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788837929.897949:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbe00/0x57f6d4e926af08af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.897989:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af08a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef92 expref: 37 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.898007:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbe00/0x57f6d4e926af08af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef92 expref: 36 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.898017:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff889af8e98100) 00010000:00010000:2.0:1788837929.898020:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788837929.898023:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afa6dbe00, rc 0) 00000100:00100000:2.0:1788837929.898074:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+36:15637:x1875732012864896:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 373us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837929.898081:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:1.0:1788837929.907916:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837929.908042:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012865024 00000100:00100000:3.0:1788837929.908068:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012865024 00000100:00100000:3.0:1788837929.908126:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:3.0:1788837929.908137:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+6:2396:x1875732012865024:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788837929.908154:0:18707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837929.908185:0:18707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a58f2dc/0x57f6d4e926af08b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003ef99 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837929.908213:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f802a, blocks: 0x0 00010000:00010000:3.0:1788837929.908235:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=546s v=(0 0) 00010000:00010000:3.0:1788837929.908240:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837929.908250:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a58f2dc/0x57f6d4e926af08b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef99 expref: 7 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.908270:0:18707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a58f2dc/0x57f6d4e926af08b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef99 expref: 7 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.908284:0:18707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ad8ac7200, rc 0) 00000100:00100000:3.0:1788837929.908344:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+7:2396:x1875732012865024:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 209us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837929.908352:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:0.0:1788837929.912679:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837929.913706:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012865280 00000100:00100000:3.0:1788837929.913717:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012865280 00000100:00100000:3.0:1788837929.913812:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:3.0:1788837929.913824:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+36:15637:x1875732012865280:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788837929.913940:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+36:15637:x1875732012865280:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 119us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837929.913965:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:1.0:1788837929.925485:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837929.925587:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012865408 00000100:00100000:2.0:1788837929.925599:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012865408 00000100:00100000:2.0:1788837929.925672:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:2.0:1788837929.925683:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+36:15637:x1875732012865408:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788837929.927948:0:17180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788837929.927963:0:17180:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788837929.928010:0:17180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1788837929.928156:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af06ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928169:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af06ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928187:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af06ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928209:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afbea7a00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837929.928215:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af06ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928223:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af06ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.928228:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af0743 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.928236:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af0743 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928239:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff889b01a1f400) 00010000:00010000:2.0:1788837929.928241:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af0743 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928243:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837929.928246:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dae00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837929.928247:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af06ef lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.928249:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af0743 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928253:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af06ef lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.928261:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af0743 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.928269:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff889af8e98700) 00010000:00010000:2.0:1788837929.928271:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788837929.928274:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af06f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.928275:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af0743 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837929.928282:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dae00/0x57f6d4e926af0743 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928282:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af06f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928288:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af06f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928292:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6db000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837929.928295:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af06f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928300:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af06f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928315:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff889af8e98700) 00010000:00010000:0.0:1788837929.928317:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837929.928319:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af06f6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928324:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db000/0x57f6d4e926af06f6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928333:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af079e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928338:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af079e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928343:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af079e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928347:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dbc00 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837929.928349:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af079e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928355:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af079e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928360:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff889af8e98300) 00010000:00010000:0.0:1788837929.928362:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837929.928365:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af079e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928370:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbc00/0x57f6d4e926af079e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837929.928406:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067bdd78-c556-4265-9b97-e4112a37245c+17:15637:x1875732012865408:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 Request processed in 2722us (2928us total) trans 0 rc 0/0 00010000:00010000:0.0:1788837929.928409:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17000/0x57f6d4e926af0823 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837929.928416:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 61 00010000:00010000:0.0:1788837929.928416:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17000/0x57f6d4e926af0823 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928421:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17000/0x57f6d4e926af0823 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928443:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837929.928446:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17000/0x57f6d4e926af0823 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928452:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17000/0x57f6d4e926af0823 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928461:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:0.0:1788837929.928463:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837929.928466:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17000/0x57f6d4e926af0823 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928472:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17000/0x57f6d4e926af0823 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928483:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af089a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928488:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af089a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928493:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af089a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928503:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac6000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:0.0:1788837929.928506:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af089a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928511:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af089a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928519:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff889af8e98100) 00010000:00010000:0.0:1788837929.928521:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788837929.928524:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af089a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.928529:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af089a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837929.928578:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837929.928593:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037053696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788837929.928647:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837929.929293:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037053696 00000100:00100000:0.0:1788837929.929301:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037053696 00000100:00100000:0.0:1788837929.929349:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788837929.929358:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875732037053696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788837929.929476:0:18708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788837929.929480:0:18708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788837929.929483:0:18708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788837929.929485:0:18708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788837930 -> 1788837930 00002000:00010000:0.0:1788837929.929488:0:18708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788837929.929585:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875732037053696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (937us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788837929.929592:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788837929.932595:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837929.932752:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012865536 00000100:00100000:3.0:1788837929.932763:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012865536 00000100:00100000:3.0:1788837929.932850:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:3.0:1788837929.932872:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+7:2395:x1875732012865536:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788837929.932987:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+7:2395:x1875732012865536:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 Request processed in 127us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837929.932995:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 28 00000004:00080000:2.0:1788837929.938545:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff889b00cb2680/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788837929.938560:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037053696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788837929.944635:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837929.944851:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012865792 00000100:00100000:3.0:1788837929.944873:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012865792 00000100:00100000:3.0:1788837929.944939:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:3.0:1788837929.944949:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+15:15637:x1875732012865792:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788837929.945006:0:19205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837929.945036:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6dbe00/0x57f6d4e926af08af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef92 expref: 15 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.945055:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff889af8e98100) 00010000:00010000:3.0:1788837929.945061:0:19205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837929.945092:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7c00/0x57f6d4e926af08bd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.945107:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7c00/0x57f6d4e926af08bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.945117:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7c00/0x57f6d4e926af08bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837929.945288:0:19205:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023c01dfc reply state 000000005fb917c5 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7c00/0x57f6d4e926af08bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.945301:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7c00/0x57f6d4e926af08bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.945307:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff889af8e98100) 00010000:00010000:3.0:1788837929.945310:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788837929.945313:0:19205:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837929.945596:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+16:15637:x1875732012865792:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 647us (970us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788837929.945676:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:3.0:1788837929.949591:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837929.949812:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012865920 00000100:00100000:0.0:1788837929.949833:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012865920 00000100:00100000:0.0:1788837929.949887:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:0.0:1788837929.949899:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067bdd78-c556-4265-9b97-e4112a37245c+7:15637:x1875732012865920:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788837929.949919:0:18708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837929.949937:0:18708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4b23b2f/0x57f6d4e926af08c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003efa0 expref: -99 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.949971:0:18708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a58f2dc/0x57f6d4e926af08b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef99 expref: 8 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.949981:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837929.949985:0:18708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837929.949991:0:18708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4b23b2f/0x57f6d4e926af08c4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003efa0 expref: 8 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.950028:0:18708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a58f2dc/0x57f6d4e926af08b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef99 expref: 8 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.950042:0:18708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a58f2dc/0x57f6d4e926af08b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef99 expref: 8 pid: 18707 timeout: 646 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837929.950056:0:18708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18708:1875732037053824:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788837929.950134:0:18708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c3748240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837929.959700:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837929.960051:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012866048 00000100:00100000:3.0:1788837929.960061:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012866048 00010000:00010000:3.0:1788837929.960105:0:17187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a58f2dc/0x57f6d4e926af08b6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef99 expref: 9 pid: 18707 timeout: 646 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837929.960154:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:3.0:1788837929.960163:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067bdd78-c556-4265-9b97-e4112a37245c+9:2395:x1875732012866048:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837929.960224:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837929.960248:0:17187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a58f2dc/0x57f6d4e926af08b6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef99 expref: 9 pid: 18707 timeout: 646 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.960262:0:17187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a58f2dc/0x57f6d4e926af08b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef99 expref: 9 pid: 18707 timeout: 646 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.960297:0:17187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837929.960301:0:17187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837929.960308:0:17187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4b23b2f/0x57f6d4e926af08c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003efa0 expref: 9 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.960317:0:17187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4b23b2f/0x57f6d4e926af08c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003efa0 expref: 9 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837929.960354:0:17187:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d4b23b2f/0x57f6d4e926af08c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003efa0 expref: 9 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837929.960370:0:17187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17187:1875732037053952:192.168.201.3@tcp:105: 00010000:00010000:0.0:1788837929.961084:0:18708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a58f2dc/0x57f6d4e926af08b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef99 expref: 9 pid: 18707 timeout: 646 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837929.961117:0:18708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18708:1875732037053824:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788837929.961144:0:18708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4b23b2f/0x57f6d4e926af08c4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003efa0 expref: 8 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837929.961155:0:18708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889ac2b17000, rc 0) 00000100:00100000:0.0:1788837929.961220:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067bdd78-c556-4265-9b97-e4112a37245c+8:15637:x1875732012865920:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 11323us (11637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837929.961228:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:1.0:1788837929.963507:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae1343a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788837929.979264:0:17187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17187:1875732037053952:192.168.201.3@tcp:105: 00010000:00010000:0.0:1788837929.979293:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837929.979401:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067bdd78-c556-4265-9b97-e4112a37245c+7:2395:x1875732012866048:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 19237us (19707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837929.979413:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:1.0:1788837930.004725:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837930.004994:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012866176 00000100:00100000:0.0:1788837930.005006:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012866176 00000100:00100000:0.0:1788837930.005067:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:0.0:1788837930.005078:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+7:2396:x1875732012866176:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788837930.005256:0:18707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788837930.005260:0:18707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788837929 00002000:00010000:0.0:1788837930.005263:0:18707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788837928 00002000:00010000:0.0:1788837930.005265:0:18707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788837930 -> 1788837929 00002000:00010000:0.0:1788837930.005268:0:18707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788837930.009711:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+8:2396:x1875732012866176:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 4622us (4983us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788837930.009740:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:0.0:1788837930.029568:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837930.029730:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012866304 00000100:00100000:3.0:1788837930.029740:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012866304 00000100:00100000:3.0:1788837930.029821:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:3.0:1788837930.029831:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067bdd78-c556-4265-9b97-e4112a37245c+8:2395:x1875732012866304:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788837930.029936:0:19019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000077df3cf7/0x57f6d4e926af08cb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.029960:0:19019:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4b23b2f/0x57f6d4e926af08c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x857683b40003efa0 expref: 8 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.029969:0:19019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837930.029973:0:19019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788837930.029991:0:19019:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077df3cf7/0x57f6d4e926af08cb lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.030027:0:19019:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4b23b2f/0x57f6d4e926af08c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x857683b40003efa0 expref: 8 pid: 18708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.030042:0:19019:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4b23b2f/0x57f6d4e926af08c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003efa0 expref: 8 pid: 18708 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837930.030056:0:19019:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19019:1875732037054080:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788837930.030139:0:19019:0:(client.c:2715:ptlrpc_set_wait()) set ffff8899c2298b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788837930.032974:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837930.033076:0:19019:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19019:1875732037054080:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837930.033103:0:19019:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000077df3cf7/0x57f6d4e926af08cb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837930.033160:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012866432 00000100:00100000:1.0:1788837930.033177:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012866432 00010000:00010000:1.0:1788837930.033213:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4b23b2f/0x57f6d4e926af08c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003efa0 expref: 9 pid: 18708 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837930.033256:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:1.0:1788837930.033264:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067bdd78-c556-4265-9b97-e4112a37245c+9:2396:x1875732012866432:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837930.033279:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837930.033301:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4b23b2f/0x57f6d4e926af08c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003efa0 expref: 9 pid: 18708 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837930.033314:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4b23b2f/0x57f6d4e926af08c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003efa0 expref: 9 pid: 18708 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837930.033336:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4b23b2f/0x57f6d4e926af08c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x857683b40003efa0 expref: 9 pid: 18708 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837930.033351:0:17186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837930.033355:0:17186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788837930.033361:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077df3cf7/0x57f6d4e926af08cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837930.033371:0:17186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077df3cf7/0x57f6d4e926af08cb lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837930.033399:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837930.033463:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067bdd78-c556-4265-9b97-e4112a37245c+8:2396:x1875732012866432:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 199us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837930.033472:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00010000:00010000:3.0:1788837930.033692:0:19019:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000077df3cf7/0x57f6d4e926af08cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.033713:0:19019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077df3cf7/0x57f6d4e926af08cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.033732:0:19019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000077df3cf7/0x57f6d4e926af08cb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.033741:0:19019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077df3cf7/0x57f6d4e926af08cb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.033749:0:19019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077df3cf7/0x57f6d4e926af08cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.033755:0:19019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6dae00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:3.0:1788837930.033760:0:19019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077df3cf7/0x57f6d4e926af08cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.033768:0:19019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077df3cf7/0x57f6d4e926af08cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.033803:0:19019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077df3cf7/0x57f6d4e926af08cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.033811:0:19019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077df3cf7/0x57f6d4e926af08cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837930.033880:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067bdd78-c556-4265-9b97-e4112a37245c+7:2395:x1875732012866304:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 Request processed in 4051us (4325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837930.033888:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:2.0:1788837930.040995:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837930.041146:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012866688 00000100:00100000:3.0:1788837930.041157:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012866688 00000100:00100000:3.0:1788837930.041231:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:3.0:1788837930.041242:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+16:15637:x1875732012866688:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788837930.041325:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.041343:0:17200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af081c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef61 expref: 16 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.041354:0:17200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.041404:0:17200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af081c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef61 expref: 16 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.041419:0:17200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af081c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef61 expref: 16 pid: 19205 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837930.041433:0:17200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17200:1875732037054208:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788837930.041516:0:17200:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae13433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837930.055630:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837930.055833:0:17200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17200:1875732037054208:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837930.055875:0:17200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837930.055952:0:20228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012866816 00000100:00100000:2.0:1788837930.055959:0:20228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012866816 00010000:00010000:2.0:1788837930.055994:0:20228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af081c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef61 expref: 17 pid: 19205 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837930.056036:0:20228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:2.0:1788837930.056046:0:20228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067bdd78-c556-4265-9b97-e4112a37245c+17:2395:x1875732012866816:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788837930.056062:0:20228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788837930.056069:0:20228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af081c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef61 expref: 17 pid: 19205 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.056080:0:20228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af081c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef61 expref: 17 pid: 19205 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.056115:0:20228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af081c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef61 expref: 17 pid: 19205 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.056129:0:20228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:2.0:1788837930.056134:0:20228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7000/0x57f6d4e926af0838 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef6f expref: 16 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.056143:0:20228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.056149:0:20228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.056156:0:20228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.056195:0:20228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788837930.056251:0:20228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067bdd78-c556-4265-9b97-e4112a37245c+16:2395:x1875732012866816:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 206us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837930.056259:0:20228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00010000:00010000:3.0:1788837930.057765:0:17200:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.057803:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.058090:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.058107:0:17200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af08a1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef8b expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.058116:0:17200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.058153:0:17200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af08a1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef8b expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.058178:0:17200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af08a1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef8b expref: 16 pid: 17201 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837930.058194:0:17200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17200:1875732037054336:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788837930.058319:0:17200:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae1343d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837930.071113:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837930.071214:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012866944 00000100:00100000:0.0:1788837930.071226:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012866944 00010000:00010000:0.0:1788837930.071271:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af08a1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef8b expref: 17 pid: 17201 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837930.071309:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:0.0:1788837930.071318:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889ac85e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067bdd78-c556-4265-9b97-e4112a37245c+17:2396:x1875732012866944:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788837930.071335:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837930.071341:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af08a1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef8b expref: 17 pid: 17201 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.071354:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af08a1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef8b expref: 17 pid: 17201 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.071387:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff889af8e98100) 00010000:00010000:0.0:1788837930.071392:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.071402:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.071410:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.071429:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837930.071489:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889ac85e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067bdd78-c556-4265-9b97-e4112a37245c+17:2396:x1875732012866944:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 171us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837930.071513:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 22 00010000:00010000:3.0:1788837930.072708:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6db800/0x57f6d4e926af08a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x857683b40003ef8b expref: 16 pid: 17201 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837930.072728:0:17200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17200:1875732037054336:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788837930.072763:0:17200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.072773:0:17200:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.072802:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788837930.072915:0:17200:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1788837930.073029:0:17200:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1788837930.073067:0:17200:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1788837930.073159:0:17200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889b00cb0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17200:1875732037054464:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788837930.073586:0:17200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837930.073637:0:17200:0:(client.c:2715:ptlrpc_set_wait()) set ffff889ae1343600 going to sleep for 11 seconds 00000100:00100000:1.0:1788837930.073761:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037054464 00000100:00100000:1.0:1788837930.073768:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037054464 00000100:00100000:1.0:1788837930.073846:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788837930.073855:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17200:x1875732037054464:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788837930.073956:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17200:x1875732037054464:12345-0@lo:1000:mdt00_000.0 Request processed in 101us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837930.073963:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788837930.074063:0:17200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889b00cb0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17200:1875732037054464:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788837930.074253:0:17200:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788837930.074308:0:17200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17200:1875732037054592:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788837930.074343:0:17200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837930.074382:0:17200:0:(client.c:2715:ptlrpc_set_wait()) set ffff889aded93480 going to sleep for 11 seconds 00000100:00100000:1.0:1788837930.074557:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037054592 00000100:00100000:1.0:1788837930.074562:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037054592 00000100:00100000:1.0:1788837930.074609:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788837930.074618:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17200:x1875732037054592:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788837930.074722:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17200:x1875732037054592:12345-0@lo:1000:mdt00_000.0 Request processed in 105us (378us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788837930.074729:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788837930.075028:0:17200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17200:1875732037054592:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788837930.075078:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075087:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075094:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075100:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac6000 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837930.075105:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075113:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075129:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff889af8e98100) 00010000:00010000:2.0:1788837930.075132:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837930.075136:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075142:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac6000/0x57f6d4e926af08d9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075185:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af0831 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075191:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af0831 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075207:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af0831 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075222:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837930.075225:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af0831 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075231:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af0831 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075240:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:2.0:1788837930.075243:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788837930.075250:0:17200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7000/0x57f6d4e926af0838 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef6f expref: 19 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075261:0:17200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7000/0x57f6d4e926af0838 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef6f expref: 19 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075271:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7000/0x57f6d4e926af0838 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef6f expref: 19 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.075324:0:17200:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7000/0x57f6d4e926af0838 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003ef6f expref: 19 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837930.075337:0:17200:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889affc4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17200:1875732037054720:192.168.201.3@tcp:105: 00000100:00100000:2.0:1788837930.075690:0:17200:0:(client.c:2715:ptlrpc_set_wait()) set ffff889afa65de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837930.078912:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837930.079016:0:17200:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889affc4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17200:1875732037054720:192.168.201.3@tcp:105: 00010000:00010000:2.0:1788837930.079046:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af0831 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079074:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da200/0x57f6d4e926af0831 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079108:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af08e0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079122:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af08e0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079132:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af08e0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079143:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af08e0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079149:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af08e0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079157:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af08e0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079162:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da400 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837930.079166:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af08e0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079184:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af08e0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079194:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:2.0:1788837930.079197:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837930.079200:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af08e0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079213:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afa6da400/0x57f6d4e926af08e0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079222:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079227:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079233:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079238:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ad8ac7200 already unused, calling callback (ffffffffc183a4f0) 00010000:00010000:2.0:1788837930.079241:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079246:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079253:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:2.0:1788837930.079256:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788837930.079258:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.079263:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ad8ac7200/0x57f6d4e926af08d2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837930.079442:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067bdd78-c556-4265-9b97-e4112a37245c+19:15637:x1875732012866688:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 38201us (38458us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788837930.079451:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 63 00000020:00080000:2.0:1788837930.079463:0:17200:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788837930.079627:0:17236:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788837930.079632:0:17236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788837930.079645:0:17236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788837930.079651:0:17236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788837930.080223:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012867072 00000100:00100000:0.0:1788837930.080232:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012867072 00000100:00100000:0.0:1788837930.080275:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:0.0:1788837930.080285:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c269f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067bdd78-c556-4265-9b97-e4112a37245c+19:15636:x1875732012867072:12345-192.168.201.3@tcp:49:dd.0 00000100:00100000:0.0:1788837930.080396:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c269f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067bdd78-c556-4265-9b97-e4112a37245c+19:15636:x1875732012867072:12345-192.168.201.3@tcp:49:dd.0 Request processed in 113us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837930.080403:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:1.0:1788837930.085503:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837930.085554:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837930.085644:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012867328 00000100:00100000:0.0:1788837930.085654:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012867328 00000100:00100000:0.0:1788837930.085715:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:0.0:1788837930.085725:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067bdd78-c556-4265-9b97-e4112a37245c+19:15637:x1875732012867328:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788837930.086033:0:17203:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788837930.086068:0:17203:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788837930.086103:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17a00/0x57f6d4e926af08e7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.086121:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17a00/0x57f6d4e926af08e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.086133:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17a00/0x57f6d4e926af08e7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.086142:0:17203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17a00/0x57f6d4e926af08e7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.086149:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17a00/0x57f6d4e926af08e7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.086177:0:17203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17a00/0x57f6d4e926af08e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.086198:0:17203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788837930.086296:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067bdd78-c556-4265-9b97-e4112a37245c+21:15637:x1875732012867328:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 570us (802us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788837930.086305:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00000020:00080000:0.0:1788837930.086310:0:17203:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788837930.086501:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837930.086509:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17a00/0x57f6d4e926af08e7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.086517:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b17a00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837930.086521:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17a00/0x57f6d4e926af08e7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.086529:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17a00/0x57f6d4e926af08e7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.086544:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff889af8e98100) 00010000:00010000:2.0:1788837930.086547:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788837930.086552:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17a00/0x57f6d4e926af08e7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.086558:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889ac2b17a00/0x57f6d4e926af08e7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.086570:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837930.086572:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837930.086573:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837930.086629:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012867456 00000100:00100000:3.0:1788837930.086634:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012867456 00000100:00100000:3.0:1788837930.086671:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:3.0:1788837930.086679:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+21:15636:x1875732012867456:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:3.0:1788837930.086691:0:19205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837930.086704:0:19205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af08ee lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x857683b40003efa7 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.086732:0:19205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af08f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.086742:0:19205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af08f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.086751:0:19205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af08f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.086869:0:19205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea6200/0x57f6d4e926af08ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003efa7 expref: 23 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.086884:0:19205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889afbea7a00/0x57f6d4e926af08f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x857683b40003efa7 expref: 22 pid: 19205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837930.086892:0:19205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff889af8e98b00) 00010000:00010000:3.0:1788837930.086894:0:19205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788837930.086897:0:19205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889afbea7a00, rc 0) 00000100:00100000:3.0:1788837930.086932:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+22:15636:x1875732012867456:12345-192.168.201.3@tcp:101:dd.0 Request processed in 254us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837930.086938:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 64 00010000:00010000:3.0:1788837930.300216:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837930.356714:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837930.356839:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012867584 00000100:00100000:2.0:1788837930.356849:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012867584 00000100:00100000:2.0:1788837930.356921:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:2.0:1788837930.356932:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:067bdd78-c556-4265-9b97-e4112a37245c+7:2395:x1875732012867584:12345-192.168.201.3@tcp:4:dd.0 00002000:00010000:2.0:1788837930.356983:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f8029, atime: 0x6a9f8028, ctime: 0x6a9f8029, blocks: 0x0 00010000:00010000:2.0:1788837930.356993:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af08fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.357031:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1788837930.357036:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837930.357043:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af08fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.357058:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af08fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837930.371557:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837930.371707:0:18714:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788837930.371717:0:18714:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788837930.377152:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012867712 00000100:00100000:3.0:1788837930.377178:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012867712 00000100:00100000:0.0:1788837930.389524:0:20342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:0.0:1788837930.389547:0:20342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:067bdd78-c556-4265-9b97-e4112a37245c+9:2396:x1875732012867712:12345-192.168.201.3@tcp:4:dd.0 00010000:00010000:0.0:1788837930.389591:0:20342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003048600c/0x57f6d4e926af0903 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.389610:0:20342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837930.389615:0:20342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837930.389621:0:20342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003048600c/0x57f6d4e926af0903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.389635:0:20342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003048600c/0x57f6d4e926af0903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837930.426028:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037054976:0@lo:400:kworker.0 00000100:00100000:1.0:1788837930.426105:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837930.426140:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037055488:0@lo:400:kworker.0 00000100:00100000:1.0:1788837930.426185:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837930.426205:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037056000:0@lo:400:kworker.0 00000100:00100000:1.0:1788837930.426229:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837930.427065:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037054848:0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.427120:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837930.427152:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037055360:0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.427446:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037054976 00000100:00100000:0.0:1788837930.427455:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037054976 00000100:00100000:0.0:1788837930.427504:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037055488 00000100:00100000:0.0:1788837930.427508:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037055488 00000100:00100000:0.0:1788837930.427525:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788837930.427533:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037054976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.427586:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037054976:12345-0@lo:400:kworker.0 Request processed in 54us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837930.427606:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788837930.427625:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788837930.427631:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037055488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.427679:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875732037055488:12345-0@lo:400:kworker.0 Request processed in 47us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837930.427686:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788837930.427721:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037054848 00000100:00100000:0.0:1788837930.427725:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037054848 00000100:00100000:0.0:1788837930.427750:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788837930.427757:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3648:x1875732037054848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.427831:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42f6ebb-a489-4c0b-be2b-e965e16a506d+24:3648:x1875732037054848:12345-0@lo:400:kworker.0 Request processed in 75us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837930.427839:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788837930.427905:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037055232:0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.427934:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837930.435740:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037055104:0@lo:400:kworker.0 00000100:00100000:1.0:1788837930.449737:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037056512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837930.449820:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837930.449835:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037056000 00000100:00100000:2.0:1788837930.449845:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037056000 00000100:00100000:1.0:1788837930.449848:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037056512 00000100:00100000:1.0:1788837930.449854:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037056512 00000100:00100000:3.0:1788837930.449925:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837930.449955:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037055872:0@lo:400:kworker.0 00000100:00100000:3.0:1788837930.449986:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837930.450006:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037056384:0@lo:400:kworker.0 00000100:00100000:3.0:1788837930.450028:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837930.450066:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d42f6ebb-a489-4c0b-be2b-e965e16a506d:3648:1875732037054848:0@lo:400:kworker.0 00000100:00100000:3.0:1788837930.450094:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037055360 00000100:00100000:3.0:1788837930.450112:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037055360 00000100:00100000:3.0:1788837930.450143:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037055872 00000100:00100000:3.0:1788837930.450145:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037055872 00000100:00100000:3.0:1788837930.450153:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037056384 00000100:00100000:3.0:1788837930.450155:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037056384 00000100:00100000:0.0:1788837930.450587:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037054976:0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.450664:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875732037055488:0@lo:400:kworker.0 00000100:00100000:1.0:1788837930.450808:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788837930.450818:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037056512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788837930.450848:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788837930.450899:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037056512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837930.450906:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788837930.451183:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037056512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837930.451238:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037055232 00000100:00100000:0.0:1788837930.451243:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037055232 00000100:00100000:0.0:1788837930.451274:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788837930.451281:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037055232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.451318:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875732037055232:12345-0@lo:400:kworker.0 Request processed in 37us (23383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837930.451469:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788837930.451479:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037055360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837930.451520:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875732037055360:12345-0@lo:400:kworker.0 Request processed in 42us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837930.451526:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788837930.451556:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875732037055360:0@lo:400:kworker.0 00000100:00100000:1.0:1788837930.451575:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788837930.451586:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037055872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837930.451618:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875732037055872:12345-0@lo:400:kworker.0 Request processed in 35us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837930.451624:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788837930.451648:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875732037055872:0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.451760:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788837930.451812:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788837930.451820:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732037056000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.451856:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875732037056000:12345-0@lo:400:kworker.0 Request processed in 38us (25626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837930.451862:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788837930.451889:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875732037056000:0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.452282:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875732037055232:0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.452293:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037055744:0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.452586:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837930.452682:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037055744 00000100:00100000:1.0:1788837930.452687:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037055744 00000100:00100000:0.0:1788837930.452829:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732037056256:0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.452860:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837930.452878:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037056768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837930.452919:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837930.453101:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788837930.453182:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037055744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837930.453225:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037055744:12345-0@lo:400:kworker.0 Request processed in 46us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837930.453232:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788837930.453304:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037055744:0@lo:400:kworker.0 00000100:00100000:1.0:1788837930.453500:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037056768 00000100:00100000:1.0:1788837930.453505:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037056768 00000100:00100000:1.0:1788837930.453532:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788837930.453541:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037056768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788837930.453554:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788837930.453591:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875732037056768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837930.453598:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788837930.453634:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875732037056768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837930.453751:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037056256 00000100:00100000:0.0:1788837930.453765:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037056256 00000100:00100000:1.0:1788837930.453911:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788837930.453918:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c3d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732037056256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837930.453969:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875732037056256:12345-0@lo:400:kworker.0 Request processed in 52us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837930.453976:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788837930.454239:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875732037056256:0@lo:400:kworker.0 00000100:00080000:2.0:1788837930.460647:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837930.460661:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837930.460666:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837930.460720:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837930.460793:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037055104 00000100:00100000:0.0:1788837930.460803:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037055104 00000100:00100000:2.0:1788837930.460805:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889afc3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037055616:0@lo:400:kworker.0 00000100:00100000:2.0:1788837930.460886:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837930.460889:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788837930.460902:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875732037055104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837930.460913:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037056128:0@lo:400:kworker.0 00000100:00100000:2.0:1788837930.460941:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837930.460958:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c3d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037056640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837930.460981:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837930.462338:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037055616 00000100:00100000:1.0:1788837930.462348:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037055616 00000100:00100000:3.0:1788837930.464091:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037056128 00000100:00100000:3.0:1788837930.464101:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037056128 00000100:00100000:0.0:1788837930.469492:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788837930.469515:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732037056384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837930.470412:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875732037056384:12345-0@lo:400:kworker.0 Request processed in 901us (20377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837930.470422:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788837930.470474:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037056640 00000100:00100000:0.0:1788837930.470482:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037056640 00000100:00100000:0.0:1788837930.470522:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788837930.470530:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875732037056640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837930.470550:0:18711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 34029248 pending 7704576 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788837930.470708:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875732037056640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 178us (9725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837930.470716:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788837930.470771:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4bace00 x1875732037056384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837930.470803:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875732037056384:0@lo:400:kworker.0 00000100:00080000:2.0:1788837930.471115:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837930.471153:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c3d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037056640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837930.471221:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875732037055104:12345-0@lo:400:kworker.0 Request processed in 10322us (10504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837930.471230:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788837930.471262:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875732037055104:0@lo:400:kworker.0 00000100:00080000:2.0:1788837930.471291:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837930.473192:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788837930.473205:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037056128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837930.473288:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875732037056128:12345-0@lo:400:kworker.0 Request processed in 87us (12346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837930.473295:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1788837930.473335:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8899c4baca80 x1875732037056128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788837946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837930.473348:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875732037056128:0@lo:400:kworker.0 00000100:00100000:1.0:1788837930.481385:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788837930.481407:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037055616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837930.481515:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875732037055616:12345-0@lo:400:kworker.0 Request processed in 118us (20630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837930.481536:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788837930.481593:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889afc3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875732037055616:0@lo:400:kworker.0 00000001:00080000:1.0:1788837930.517878:0:18703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1788837930.517896:0:18703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1788837930.518344:0:18712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1788837930.518350:0:18712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788837929 -> 1788837930 00002000:00010000:2.0:1788837930.518354:0:18712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788837929 -> 1788837930 00002000:00010000:2.0:1788837930.518356:0:18712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 14952 00010000:00010000:2.0:1788837930.518389:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af08fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.518404:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af08fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.518414:0:18712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af08fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.518422:0:18712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889afa6da200 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:2.0:1788837930.518428:0:18712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af08fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.518451:0:18712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af08fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.518472:0:18712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af08fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837930.518480:0:18712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f434be9/0x57f6d4e926af08fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837930.518587:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:067bdd78-c556-4265-9b97-e4112a37245c+9:2395:x1875732012867584:12345-192.168.201.3@tcp:4:dd.0 Request processed in 161651us (161878us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788837930.519911:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00000001:00080000:1.0:1788837930.524759:0:18703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:0.0:1788837930.526284:0:20342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003048600c/0x57f6d4e926af0903 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.526302:0:20342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003048600c/0x57f6d4e926af0903 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.526327:0:20342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003048600c/0x57f6d4e926af0903 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.526336:0:20342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889ac2b16e00 already unused, calling callback (ffffffffc0bfc420) 00010000:00010000:0.0:1788837930.526341:0:20342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003048600c/0x57f6d4e926af0903 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.526350:0:20342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003048600c/0x57f6d4e926af0903 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.526437:0:20342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003048600c/0x57f6d4e926af0903 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837930.526446:0:20342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003048600c/0x57f6d4e926af0903 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837930.526614:0:20342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c3d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:067bdd78-c556-4265-9b97-e4112a37245c+5:2396:x1875732012867712:12345-192.168.201.3@tcp:4:dd.0 Request processed in 137070us (155059us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788837930.526624:0:20342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:1.0:1788837930.937230:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037056896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837930.937316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837930.937666:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037056896 00000100:00100000:0.0:1788837930.937675:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037056896 00000100:00100000:0.0:1788837930.937736:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788837930.937748:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037056896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837930.937825:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788837930.937884:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875732037056896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837930.937905:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788837930.938051:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875732037056896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837930.939193:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8899c4bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037057024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837930.939259:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837930.939503:0:18161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732037057024 00000100:00100000:0.0:1788837930.939510:0:18161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732037057024 00000100:00100000:0.0:1788837930.939556:0:18161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788837930.939566:0:18161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037057024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837930.939607:0:18161:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788837930.939661:0:18161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875732037057024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837930.939668:0:18161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788837930.939932:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8899c4bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875732037057024:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788837931.323897:0:17189:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788837931.902389:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1788837932.241322:0:20379:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788837932.345841:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837932.536258:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837932.536310:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837932.536341:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012867840 00000100:00100000:2.0:1788837932.536346:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837932.536354:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012867840 00000100:00100000:2.0:1788837932.536377:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837932.536399:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837932.536416:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788837932.536419:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 169 00000100:00100000:0.0:1788837932.536431:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889aec36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:2393:x1875732012867840:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837932.536436:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788837932.536461:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012868096 00000100:00100000:2.0:1788837932.536494:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012868096 00000100:00100000:0.0:1788837932.536526:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889aec36e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7253ef40-cd6d-4a26-9386-e23758a56a4e+13:2393:x1875732012867840:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 97us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837932.536535:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 169 00000100:00100000:2.0:1788837932.536540:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012868608 00000100:00100000:2.0:1788837932.536543:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012868608 00000100:00100000:2.0:1788837932.536555:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012867968 00000100:00100000:2.0:1788837932.536557:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012867968 00000100:00100000:2.0:1788837932.536573:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 71 00000100:00100000:2.0:1788837932.536580:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+5:2393:x1875732012868096:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837932.536615:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+5:2393:x1875732012868096:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 36us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837932.536622:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 71 00000100:00100000:2.0:1788837932.536636:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:2.0:1788837932.536642:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2393:x1875732012868608:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837932.536667:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012868352 00000100:00100000:2.0:1788837932.536667:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2393:x1875732012868608:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837932.536672:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012868352 00000100:00100000:2.0:1788837932.536674:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:2.0:1788837932.536685:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 73 00000100:00100000:2.0:1788837932.536691:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+22:2393:x1875732012867968:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837932.536721:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067bdd78-c556-4265-9b97-e4112a37245c+22:2393:x1875732012867968:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 30us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837932.536728:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 73 00000100:00100000:2.0:1788837932.536746:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012868864 00000100:00100000:2.0:1788837932.536749:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012868864 00000100:00100000:2.0:1788837932.536806:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012868224 00000100:00100000:2.0:1788837932.536810:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012868224 00000100:00100000:2.0:1788837932.536826:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:2.0:1788837932.536832:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2393:x1875732012868864:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788837932.536870:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2393:x1875732012868864:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 38us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837932.537944:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:0.0:1788837932.537996:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:1.0:1788837932.538083:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889affc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+5:2393:x1875732012868352:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788837932.538163:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889affc4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067bdd78-c556-4265-9b97-e4112a37245c+5:2393:x1875732012868352:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 159us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837932.538173:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:3.0:1788837932.538224:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889b00cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067bdd78-c556-4265-9b97-e4112a37245c+5:2393:x1875732012868224:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788837932.538262:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889b00cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067bdd78-c556-4265-9b97-e4112a37245c+5:2393:x1875732012868224:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 309us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837932.538269:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00080000:3.0:1788837932.540940:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837932.540952:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837932.540955:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837932.540958:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837932.541701:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788837932.541761:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788837932.541885:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012868736 00000100:00100000:1.0:1788837932.541903:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012868736 00000100:00100000:0.0:1788837932.541951:0:19205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875732012868480 00000100:00100000:0.0:1788837932.541963:0:19205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875732012868480 00000100:00100000:1.0:1788837932.542018:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:1.0:1788837932.542032:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2393:x1875732012868736:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837932.542116:0:19205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 74 00000100:00100000:1.0:1788837932.542185:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cd2a6f9-4711-474b-ad66-0a44190716b9+5:2393:x1875732012868736:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 154us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837932.542195:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00080000:3.0:1788837932.542214:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837932.542243:0:19205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8899c4bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2393:x1875732012868480:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788837932.542318:0:19205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8899c4bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cd2a6f9-4711-474b-ad66-0a44190716b9+6:2393:x1875732012868480:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 193us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837932.542326:0:19205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 74 00000100:00080000:3.0:1788837932.542628:0:17196:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837932.547248:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00010000:00010000:2.0:1788837933.369992:0:17953:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42122 lines, 42122 kept, 0 dropped, 0 bad.